Maybe its because he is representing the Browns whenever he is out in public and this reflects negativly on the Browns.
I know some companies have the right to discipline a worker if they are acting in a way outside of work that makes the company look bad
CBF