Want to make myself unavailable

Every time I take time off of work, I tell them that they can still call me when they need me because I know that there are things that they do not know and I do. I want to help.

But, ideally, I would like to be left alone when off and not to give my boss an option to call me.

I realize that I am people-pleasing (I don’t want them to think that I do not care about my job or them or think that I am irresponsible) and also prioritizing them and their comfort over mine (I don’t want them to be stressed and worried when they don’t know something).

What can I do?