It depends on their attitudes. Gilmore is now considered the best CB in the game. He would not be considered the best CB in the game if he still played in Buffalo, playing at the same level. For some players, this is a problem, so they need to leave Buffalo for the market that will best suit their ego.
As far as Watkins, he's just too injury prone to be available as much as they'd need him to be.