Exactly, the IRS (and state) could come after back taxes, if you do this
The IRS is not patient or kind. Maybe consult a lawyer or CPA to see what the tax risks of paying PTO when you have no contract offering PTO. Consider starting to search for a replacement, if you decide to not pay and the contractor freaks out.