It seems to me that your issue is more with Goodell than with the public. The public is always going to state their opinions about any number of topics. However, Goodell (and the NFL owners) are the ones who give those complaints power. Without somebody doing something those opinions hold no weight.
The bottom line is that it's the bottom line. If the NFL fears people will boycott their product they'll react to the mob, if they don't they'll ignore them (or placate them.) Nobody can force them to do anything. They have to power to do what they want and the public has the right to state (shout, tweet, etc.) their opinions. The system appears to be working just fine even if those shouting are highly obnoxious.