Upset because of me – what is a better thought?

Hi all! I have been diving into action / inaction, and responding to the question – when do I worry without taking action? Why?

My two immediate responses were;
– when I think someone might be upset with me
– when someone is upset because of me

I can see problems with these thoughts, because I am saying them like they are facts. And I think they are coming from the same deeper belief thought over again, that it is possible for me to control how other people think & feel. I am stumped at the moment though on how I can start to dislodge these? Would love some guidance on models to try?
I have been tying the thought “how other people think is their own models and not my business”, but it doesn’t feel true / believable (yet).

Thanks in advance!