I don't know anyone that says, "Bring on more growth!", except politicians, land owners, and developers.
Many of the things you talk about are why I left Orange County and moved to Utah 30 years ago. Now I hear and see the same things here. I'm one of the biggest complainers about how much growth is happening in Provo/Orem area and all of Utah County. I'd love to have it stay the same forever.
We love to visit Kailua on Oahu for the very same things you write about SC. The last time we were there, we were seeing a lot more people. Word got out about how great of a little beach town it is. It still is great but homes are now over a million dollars for a little shack. People like it for the laid back, small town feel but as people recognize that and start to visit, the feeling disappears. I'm part of the problem.
It is inevitable that when you live near a beach, development is going to happen. Enjoy it as long as you can. I love south Orange County for the reasons you state but I hate to say it is just a matter of time.