He does hate the vitriol that comes out of the rivalry with some fans and for that reason he was happy to skip playing each other for a while. He has had at least 1 pretty bad experience with his family during a BYU game (I personally know the guy that was standing next to Kyle's wife when it happened, so please don't start up with that again).
Kyle made a playful joke and it set off a bunch of you. It says more about some CB fans than it does about Whit.