You might make that case with Baltimore, but certainly not the Chargers. First of all, nobody cares how the team was 15 years ago let alone 5 or even 3. Where does the team stand now, and what do I bring to that equation? Baltimore has a distinct edge from a FO stability side of things, but it hasn't resulted in a significant difference in the W/L column. At the end of the day, the 3 teams combined have made the playoffs 3 times in the last 5 years. That's 3 of a possible 15. And none of the teams have made the playoffs since 2014. As far as cumulative records go, you have to go back 4 years for the Ravens to be better and more than 5 for the Chargers.
Over the past 5 years:
Bills have gone 36-44
Chargers have gone 34-46 with a playoff appearance in 2013 with a record of 9-7
Ravens have gone 41-39 with both playoff appearances coming off a record of 10-6