I did the same. Of the 50 students in my grad program I was the only
the only one from west of the Mississippi and the only one not from another Ivy or elite Eastern liberal arts school.
Obviously there are good BYU students who can thrive in elite grad programs, but getting in is the trick.