the ref was likely thinking that he didn't get in the endzone so the game is over. So in the ref's mind he is thinking it was like a two-point conversion play where the refs indicate it was good or not.
When really he should have given the complete signal and marked the spot at the 2 yard line.