If you're careful with where you apply it, Neem oil is an effective, natural way. Or, you can wait until Fall and
then disturb the top 2" or so of soil where they lay their young-uns. The exposure and birds will do the rest.
As for Neem oil, there are arguments for it and against it. But it's supposed to be quite effective.