Make it fair to all teams. If it is an 18 game season with 2 bye weeks, just make week 7 and 14 byes for the entire league. Play 6 games, get a bye, play 6 games, get a bye, play 6 games - playoffs or go home.
This would eliminate the disadvantage of playing a team coming off a bye, and balance the scales a little bit so teams aren't getting stuck with a bye in week 4 after just 3 games played.