Genius, the issue isn't being pushed into Brady, it's being pushed into his knees. And whether you can process it or not, Morris impacted Pollard's trajectory. How much, no one can say for sure, but Morris clearly re-engages Pollard, and thus there was no penalty called on the play.
Now the play will be subject to a penalty because, well, you just cannot lunge after a QB after getting knocked down. Makes about as much sense as a QB needing to "tuck" the ball after a pass attempt.