Youth soccer in my area is having a very hard time filling games with refs. No one should be abusing refs for any reason, even if you think the ref "signed up for it."
And I get it. It's tough sometimes. I yelled at a ref once myself this past season. I was trying to be helpful, but still, it wasn't the right thing to do. And justifying it for any reason isn't right.