Levi Wallace had the unfortunate job of being the worst DB on a group with All-Pros. Which meant if teams were going to target anyone, he was #1, #2, and #3.
Benford/Elam/Dane are all around the same level of play, and thus none of them are challenged as much as Levi was.