I don't think you're putting your family in a better position overall. Being close to grandparents is awesome, but you will be isolated there. People will be lonely. I don't think I ever understood the importance of community like I do now (after being in a position where we didn't have it). If there's not a solid community to support you, this isn't the right move. Grandparents are great, but that's not enough.

At least that's the way I'm reading your situation.