At this point, you cannot do this. Fine if that was the plan all along and the Bills had another QB that can actually play ( not necessarily well) in the league. Now that Allen has been the starter, you must leave him in except in case of injury. In that sense, the signing is a good one. Being one play away from being forced to play Nathan Peterman in an NFL game is a place that no team should put itself in.