It's an interesting question because we've always just assumed that a guy that touches the ball that isn't the "returner" (like on a short punt or a bounce) will cause the ball to be live even if he's in close proximity of someone on the return team that could be impeding the catch.
But I wonder this the rule is actually written.