There is no allowance for holding anywhere. Defensive holding doesn't matter where it happens. You can't hold or restrict the wide receiver from going on his route anywhere or else everyone would just grab the receiver and drag them down.