No, just depends on how you want the offense to function. Once Brady took over, there was a much more concerted effort to run the ball. With guys like Kincaid and Knox, who can also catch passes, having those guys on the field gives you more options and the ability to "hide" whats coming.
If we start having Renfrow, Shakir and Diggs in packages, its more likely a pass, which give the defense a slight advantage. I'm not saying Renfrow couldn't be useful, I've always liked him, but it may not line up with with Brady wants to do