So, we are not planning on retiring HERE where we are living and working. We want to move closer to family.

YES, we plan on having the house we are living in currently here paid off by the time we retire.

Then the plan is, hopefully, to sell it and have enough to buy something nice in retirement location.

I think in the end, it's not quite to balance out. We'll probably have to borrow a little more to get the house we want in retirement. But hopefully interest rates are lower then.... (and housing costs in Utah have cooled a little).

Right now, it looks pretty close... sell out bigger house here for a large family, buy a nice place, maybe a condo or something in Utah. Those numbers look very promising.