I think any QB who has made it to the NFL level had the ability to throw an accurate ball, but the ones who can throw consistently accurate balls (see Tom Brady) are the ones who become very good to great. Allen has NEVER shown the ability to be consistent. So you may be wowed by one out of every 4 throws he makes, well, that's not going to get it done...
We have statistics from his college career. The more passes he throws in the NFL, the more clear it will become that statistically, he's not consistent enough with his accuracy.
I can throw a football decent enough to accurately throw it through a swinging tire, but how many times out of 10 can I do that? Maybe a couple. The key to NFL QB success, is what is the success/failure rate of those throws.