I can live with refs letting them play in the trenches, as long as the more egregious holds get called. That's kind of the way the NFL is, there could be a hold on most any play in the NFL, but it's usually the takedowns, or clear grabs outside of a block that get called. The battle in the trenches is what it is, and as long as it doesn't create a significant advantage, I'll accept it. The worst holding calls are when a ref calls a lineman on the back side of a play that has no impact on the result. Again, I'm talking about the less egregious stuff, not total take downs.
In the defensive backfield, this is a completely difference scenario, since on any pass play, there are a limited number of people who can run and catch the ball, interfering with their ability to run a route outside the 5 yard buffer absolutely should be called. In the NFL, there's a whole lot of jostling that goes on, and they seem to allow it more and more in FBS these days. The play with TX & GA where they were locked up together and the defensive player turned into the ball is an example, the Georgia player was working it just as hard, and I am happy to see a no call, even if the defensive player gets a INT.
What we saw on Saturday was NOT a 'let em play' like call, in FBS or the NFL. If you grab a player and change their momentum or direction, then grab them again (pulling the jersey over the pads), and then wrap your arm around them as they run, you are going to get called for it. If the ball had been thrown his direction, it would have been PI, since it wasn't thrown, all it can be called is holding.
But how the two types of holding are called and the situations they are called under are completely different, and I love to let em play, but when you change the potential outcome of a play (by basically taking away the option of throwing to them), you deserve a penalty.