Replay assist should be there for black-and-white penalties. For example, facemasks, false starts, Offside, illegal formations, 12 men on the field, illegal hands to the face.
however, they should not intervene in the case of holding or OPI or DPI or roughing the passer. Anything that is subjective. That can get very muddy and become a flag fest if that were the case.