Depending on how much you have in other assets your spouse could see this as using your primary residence as collateral.

And with this type of loan a lender is likely to want to be in first position.