There's something very relaxing about attending a game that you really aren't nervous about. I mean, I've already paid for the tickets. It's almost a sarcastic gesture.
Besides, if your seat is already paid for, not showing up looks like you just don't care. Showing up and joining the chorus of boos shows you're unhappy with what's going on.