How do joy eats fit in with losing desire?

Thinking about the boyfriend analogy, the only way to really get over the guy is to cut ties completely. If you continue to see him, even once a week, you will never get over him- even if the encounter is planned. Taking this to food, if you are still eating the food you desire, say brownies, once a week, won’t you still always have that desire? Don’t you need to cut things off completely to allow yourself to acquire new tastes and move on? I understand that we can learn to control desire, but won’t desire always be there if we are still eating the over-desire food? Wouldn’t it be better to not have the food at all? I’d like to get to a point where that food doesn’t even phase me at all and it seems like cutting ties completely is the answer. Please help me sort this out! Thank you!