Buffering… Or Not

I’m curious about the difference between buffering and genuinely relaxing. If I’m playing a video game with my husband (one of our favorite past times after the kiddo is in bed), is that buffering? Should I be doing something productive? Same if I’m reading a book or playing a few rounds of Candy Crush… how can I tell if I’m hiding/avoiding or genuinely having fun?