Reintroducing exceptions

I’m losing weight. I’ve stopped sugar, flour and chocolate and dessert a week at a time. Now, I don’t have any of those and I don’t want to plan for exceptions for at least 6 weeks to make sure that I am fat adapted. It’s been 3 weeks.

Now that I am close to my goal weight, I wonder when I should reintroduce exceptions so I’m not afraid of food. But I don’t want it to slow my weight loss. I know I’m not supposed to do something I’m not willing to do for the rest of my life.

For example, I struggle with chocolate. As a circumstance, I think it’s good for me in small amounts which causes me to feel desire for chocolate.
I’m stopping the model there by not eating any.

I’m starting to catch my mind telling me “you will have some after you’re fat adapted or when you reach your goal weight” which is the diet mentality…
When should I reintroduce exceptions so I won’t be afraid of food?