Southern Utah, Moab, St. George sound more fun to get away or do you like Yellowstone and mountains more.
I like to do short trips to places, see outdoors etc. If either location sounds more appealing I would move closer to the one you like more. All else equal of course.
And if I had family in Idaho that I wanted to see that would affect it too.