Love during divorce, then marriage

I recently got a divorce last month and started dating a very charming and loving man 2 months during my separation period (business associate, we didn’t have an affair) and he swept me off my feet and we moved together in Jan. with my young child. We were getting a long fine, but now Im divorced, I feel like we are reverting and Im insecure from some of the things he has told me about his past when we were friends, and I keep bringing it up and he feels like I don’t trust him, which is false, however, my antenna is up, which is holding us back from going to the next level in life because of my insecurity of thinking will he do this to me? He is amazing and I love him, but I am very fearful, but were in too deep to back out now.