My point was that there are a lot of people without family connections to the Confederacy who choose to fly the flag, and it raises a lot of questions as to why they would choose that symbol.
If someone who was not French decided to fly the French flag, I'd also question that as an oddity, but it doesn't piss me off quite as much since we didn't fight a war against them over owning people.