I've been through it myself. I'm on my fourth stint as scoutmaster. If you have a boy in scouts, you should make every effort possible to be up there to support those boys. And every ward should have at least two called to that position. I've had two separate times where I went a few months without an assistant scout master. That is hard and puts so much stress on my calling.
We have wayyyyy too many parents who treat scouts as a baby sitting service where they can just drop their kids off and forget about them. I tend to get really negative about scouting. I'm burned out and tired of much of the nonsense, lack of support, and archaic records keeping by BSA. But, I take a step back, look at the sacrifices of the early church members (like the Hole in the rock expedition) and I realize that this is minor in comparison.