As with any game, alot of it depends on the people around you.
I've never had a problem, although I've seen a few. My advice is to be respectful and keep it low key, at least for a while.
I've been to away games in:
Pittsburgh
Washington
Arizona
NY (Giants & Jets)
San Diego
Cinci
Cleveland
Dallas
Houston
Heading to New Orleans this year.
If you can get in with a group of Bills Fans you'll have a much better time.