Anyone on the LOS that is not the outermost person on the LOS (I think).
This doesn't seem too hard for defenders to determine at the start of the play. Just to be clear, I'm not disputing the value of having ineligible receivers, just wondering why they can't go downfield.