I think that I would probably have a private conversation with my HR rep
I would definitely not be comfortable with that. If the tables were turned and a dude came walking out of a women's bathroom stall, it would cause a huge uproar at most offices.