Things go because people rarely intend offense when they use that word. Heck, I use it still to describe situations sometimes.
I doubt any instruction from you would have been received as intended in that circumstance. So I think you did the right thing.
I might have said something after the fact and discreetly, but probably not.