There is a difference between the 2003 patriots and the 2012 bills. You actually highlighted it above, Tom Brady. The 2003 patriots had already won a superbowl and had a young up and coming QB on their team.
The reason people are down on this team is because they came out for the season opener and laid an egg. Our "improved" journeyman QB looked worse than he every has and we let a team that is known for its offense trouble, put up 48 points against us.