consequences when metrics are not met. If the work is getting done, and goals are being met, then it doesn't matter to us. It's when work isn't being done, as you indicated. To me the problem therein lies with lack of actual consequences for those not doing the work.
Rather than penalize the entire group, get rid of those not working and replace them. That sets the bar pretty high for WFH. I'd venture to guess that some of the real issues with WFH were managers and team leads not doing their jobs in actually managing WFH employees.