There's also affinity built through going to one school rather than the other. I don't really expect church members who didn't go to BYU to feel much affinity to it unless through family members or friends.

It's sad that it happens, but it's pretty easy to see how it happens - it's the same as how you get Michigan/Michigan State fans or Washington/Washington State fans, and the accompanying rivalry animosity.