If they're walking around close to you or behind you and don't back off the instant you tell them to and then stay back, then they're going to get what they deserve and I have no problem with that because you 100% have the right to protect yourself and go home in one piece.
But those two dudes kept their distance, complied with directives and made no attempts to interfere or get too close.