Every non-SEC / Big 10 team, with the exception of ND and maybe FSU / Clemson / Miami won't be given the benefit of the doubt in the rankings unless they've absolutely dominated of late. Just look where the Big 12 teams all stack up - if Iowa State had won last weekend they'd probably be in the top 10 near BYU. One loss and they end up in the high teens. BYU has no choice right now but to keep winning. I think they could afford one loss (maybe two if they're lucky) and still be in the final 12.
I think that they CFP committee is going to have a real hard time not pushing for the recent bluebloods, even if they struggle...it will take 3 losses or more by a team like AL, GA, etc. before they're pushed outside of the top 12.