Shipping costs

I have a physical product and an audience that live in many countries. If a customer buys the product in the US the shipping price is $7 which is pretty standard. However for other countries the shipping costs are between $20-30 depending on the country. For quite a few years I didn’t charge that. I thought it was too much and so even though the shipping costs were the same, I only charged the customer half that amount. And paid the rest myself, which meant I was losing money.
After doing this year’s taxes I realized if I wanted to be a profitable business I would need to charge the costumer the actual shipping costs.
But this feels scary to me. So I haven’t yet. I feel like people will complain. It makes no sense, but I am feeling resistance.

Thanks in advance