How do you know when you should do a model and thought work to change a feeling or whether you should set a boundary?

My partner sometimes speaks to me in a condescending tone which I hate. I never pull him up on it in the moment as I am very non-confrontational but I stew on it for a long time afterwards and feel angry that he speaks to me like this.