The people doing the wave on offense, of course. The lineman may not have had any other choice but to hold, and he may not have even held. The wave-doers, on the other hand, made a conscious decision to participate in an idiotic act.
These are the same people sitting in front of you who decide to make a beer/bathroom run at the exact moment the teams line up for a play, or worse, right in the MIDDLE of a play. If I were running things I would have gates at the end of each row and at each aisle entrance that lock shut except during timeouts and commercials. Imagine the business these guys could do with such a policy.