Being 20th in yards means very little. We are a pass heavy team with an elite QB that basically only has two WRs on the roster. There are a ton of WRs that have missed multiple games and/or are stuck in garbage offenses.
Just going through the teams I would say probably half the teams in the league have two+ WRs better than Davis. He's probably an average #2 WR.
Our lack of a slot receiver and depth are much bigger issues than Davis being the #2, no doubt. But he's not going to be worth the money he's gonna get next contract and it would be nice to upgrade anyways.