me because not everyone plays each other. There has to be some subjective information. I think you would agree a 1-loss SEC team is better than an undefeated MWC team. So, any decent model will have some other factors besides win loss record in the end. If record is all we have then we don't really have a model and we'd be back to being biased again on eye test or running up score.
I have no problem with previous year record(s) as an input. SOS should count. I think where we may disagree with these models is the weight they put on these factors.