It's vital for fans to recognize that we've played GOOD teams for the past 3 weeks. Even the Chiefs, with a bad record, had Jamaal Charles in week 1. We have been doing what most teams could only hope to do on defense, and our offense is out-scoring teams that, no matter how you play defense, are going to score a lot of points. Sure the pass rush seems like a concern, but remember that it was the defensive line that was actually giving Brady fits. He got the ball out quick every play, but he did it for a reason, and the quicker you're forced to release the ball (especially when you're Tom "I could order a pizza and have it delivered while I stand flat-footed in the pocket" Brady) mistakes can happen against 7 in coverage.
Things on defense will continue to tighten up regardless (and our secondary is injury depleted already), but make no mistake that this team overall is playing extremely well, and executing their game plan.