My colleague don’t love my way of speaking

During a meeting, my colleague tells me that he finds that I speak with aggressiveness! I do not agree with him, especially that the other colleagues did not agree with him. But it really bothered me that he told me that. He was not coherent because he also said that I also seemed directive and beware of the person who was going to contradict me … absurd thing because there was another colleague who argued and disagreed with me and I did not contradict him!
I don’t like this situation. How to resolve the situation and grow this colleague who is very susceptible?