Criminal parent? Mentally ill parent? Orphaned? Physical disability? Overbearing mother? Emotionally fragile child? Victim of bullying? Parents who argue a lot?
I bet at least one of these applies to most successful people. I don't know where you draw the line without creating more favoritism in the quest to be fair.