Actually, my point went unnoticed because of the volume of this debate. The person Jim Brown obviously is not like many of the other athletes of his generation, and he has a personality problem. If the guy is a wife beater and is proven to be a jerk because of how he acts long after his playing career was over, then people have a right to call it as they see it. Here is my example HOF list of players who don't have the image problem Jim Brown does:
Lenny Moore, Baltimore Colts, b. 1933: http://articles.baltimoresun.com/2011-11-23/sports/bs-sp-catching-up-lenny-moore-20111123_1_joe-paterno-lenny-moore-penn-state
Willie Davis, Cleveland Browns/Green Bay Packers, b. 1934: http://www.lasportshall.com/inductees/football/willie-davis/
Jim Parker, Baltimore Colts, b. 1934: http://www.baltimoresun.com/sports/ravens/bal-sp.parker19jul19,0,2116898.story
Did they have any less of a past of overt racism as Jim Brown did? Did they suffer any less than Jim Brown did? Probably not... he reacted poorly to the bad things that happened to him, and that's a choice he made, not anyone else.