From what I remember hearing, Modell was broke because he owed a ton of debts to people and the city of Cleveland and that's why he left. He had to go to 3 different banks to get money to bring Andre Rison there in their final year in that stadium. He wanted out before he had to pay everything he owed. It wasn't just because of the stadium issue.