He's embarrassed by the large vocal segment that has taken over his school as well.
Here's the difference. No one would ever even conceive of trying to argue that there's a large nasty segment of BYU fans that have taken over the school's reputation. Because it hasn't. Part of the reason is because BYU has had those standards long entrenched in their culture.