The talent pool is already diluted to the point where the on field product is inferior. There are a few GREAT teams, and everyone else kinda sucks.
The NFL CAN'T expand W/O further diminishing the quality of the game. Personally, I think that's why we see such f'd up officiating nowadays throughout the league.
Refs throw flags to keep games competitive more often, than not.