The perception of him hating BYU is what matters to the Ute mob.
FWIW I don't think he hates BYU and could easily come to BYU and be a great coach. He really did consider coming here back in '04. I don't think BYU would be an option if he truly hated BYU. He is basically Utah's greatest football coach in their history so his legacy and loyalty is there now.