The only people who hold off are those with personal biases against him, whether they believe their qb is better (Colts, Packers, 49ers), or fans of teams he owned in 20 years who just hate him no matter what he does (Bills are here). Whether you admit it or not, your personal bias is blinding you. Check out the unanimous selections for NFL 100, all decade teams etc. Brady has been unanimous many, many times. Don't say you know more about football than any of them.
Honestly, it's just better for us as fans to respect what he's doing now because it ain't happening again. If there's a trajectory we would want Josh Allen to follow, it's Brady's - let's be real here.