His companies are notorious sweat shops. His benefits aren't great. That doesn't have to be that way. Musk's fortune divided across all of America may not make a difference but that fortune spread more evenly across the employees that help generate that wealth... that would make a difference.
Musk can still be fabulously wealthy. He can reap the majority of the benefit and have the disparity not be so extreme.