Because the committee has no actual "criteria" they use + the committee members rotate and change + the SEC/B10 bias - if they can use OOC strength to get more of their teams in, it will absolutely become a narrative. Just because SMU didn't help BYU this year, doesn't mean that a sad OOC won't hurt BYU next year.
Nothing for it really, but it is a moving target with the committee.