You need to ask who transfers out of different schools. 5* guys who transfer out of big schools do so because they are underperforming. You don't see a starter at Alabama leave to be a starter at Oklahoma State unless he isn't going to start next year.
But on the flip side, starters at Oklahoma State type schools leave for schools like Alabama all the time. You also see standout players from schools like UAB jump up to big schools like Alabama.
In short, players who underperform based on their recruiting rankings go from big schools to small schools. Players who overperform their recruiting ranking go from small schools to big schools. This isn't a new concept.