Feeling guilty about not going to networking events

People ask me to go to networking events at night in San Francisco. I live in San Jose and I don’t want to go because I don’t want to deal with the traffic, the commuting, the parking, etc. I think it’s a lot of hassle and I know it’ll be a 6+ hour ordeal, because I’ve done it before and then I told myself I wouldn’t do it again. The drive is exhausting and it takes a lot of energy out of me to do all those things, on top of the networking.
My problem is I feel guilty about saying no to these events because I see other people going to the event who also live down where I live and I have the thoughts I should be going to these things, I shouldn’t care about the commute, it should be fine to make the drive up there.
I feel guilty for wanting to draw this line in the sand because I feel like I’m supposed to want to go. I’d love some help here.