Well I disagree with you.
Not really, of course. I don't think there's a conspiracy or anything to just give it to the Patriots. I DO think that refs are conditioned to expect and watch for certain things, like the Raiders committing a lot of stupid and dirty penalties (as has been their wont for 40 years), and like the defending SB champions, whoever they are, playing a good, sound fundamental game. So they see EVERYTHING the Raiders do because they're looking for it. They miss things the Pats do because they're not looking for it.
It's human nature, and it's also incompetence. What it isn't is a conspiracy.