You’d get broken noses and cuts and scrapes, but would cut way down on concussions. Less protection means you will protect you own head and neck more naturally.
As they are designed right now a football helmet is as much a weapon as it is a protection.
The answer is to go “old school”.