Can't speak to Bakersfield. People rip on it, but I'm sure there are plenty of nice neighborhoods, and it's closer to L.A. As for the Central Valley, I've always liked it there, scorching hot summers notwithstanding. Not perfect, and still subject to CA state politics and taxes, but it has its charms. And once upon a time, it was actually a near steal in terms of home prices. Less so now, but there was definitely a window in which to get in while the getting was particularly good and start building equity.
The Valley isn't awful or amazing in terms of amenities, but you're reasonably close to everything--mountains, ocean, NorCal, SoCal. Yosemite Park was an up and back day trip, and the Sequoias were even closer. Underrated area, IMO, although the aforementioned spike in housing and all things Gavin Newsome constitute downers vs. what it was before those things.