This is spelled out in the drivers training manuals. I've never seen an exception for HOV lanes, or any indication that the intent of the HOV lane is for drivers to not have to deal with traffic movement in the other lanes. Is your idea corroborated anywhere outside your mind?
The whole point of the lane is to go faster than the flow of traffic.