If these criticisms of Allen were about his performance as a quarterback, that would be entirely fair game (he's not a perfect player). As were criticisms of Jackson imo.
When it crosses into some referendum on an entire fanbase, comprised of all different kinds of people, that's a very different argument. It's irresponsible to say the least.