Would find other ways to mess around at the office. They'd give off the appearance of being busy while not really doing anything or find other ways to mess around.
Now, if those WFH people are "messing around" but still getting their work done and doing it well, then who cares? A good boss and management would be happy good work is being done. Cause otherwise it's just a complete control issue.