I'm an advisor that doesn't recommend keeping debt for tax purposes. Debt free is great. My wife and I are debt free as well. My view is if you are debt free you can save and invest more.
Just fyi, don't pay more for your medicare supplement plan than you need to since all supplement plans work 100% (plan F or plan G for example) the same. The difference is how much each carrier charges for the plan.