Its not a problem until someone does it in front of you the entire game, even at the meaningless times . . . it can be incredibly annoying.
But worse, last season my wife and I went to a game at the ralph with some friends, they brought their 10 year old son . . . some idiot near us (loudly, of course), had to use the f-bomb for very part of the sentence structure every time he opened his mouth--which was often. And, he had to stand up many time to do it. In my opinion, these are the people that should be removed, he made it terribly uncomfortable for everyone around him.