It's absolutely a noisy metric, but when we don't take care of business OOC, it sinks all boats. Because it reduces the perception of the teams that lose, which makes it less meaningful to beat them and tears down everyone's SoS.
We really need to do better OOC as a conference to start next season (which is a shame, because BYU absolutely took care of business OOC, despite playing the toughest OOC opponent)