Fair or not, certain language and phrases get co-opted and the "I'm just asking questions" phrase has been hijacked. So if you use that language, it's an indication of something whether you intended it or not. It is unfortunate for the rare person who didn't know, but that is life and life is not fair.