I said it was a judgement call, and you pointed out that the ref was bothered,
which means that he could have thrown a flag. Whether it would have been the correct call or not, the ref kept the flag in his pocket despite being bothered by what he saw.