If I still get excited about my food and eat whole grains and whole wheat flour can I still lose my over desire for these foods.

I would like whole wheat flour and sugar to be a part of my life on occasion (once or twice a week). I know there are exceptions/joy eats, but if I eat these things, can my desire for them really go away or am I “cutting off my tail one inch at a time”? (that’s my father-in-laws saying and I had to use it)