I drove all the time in Japan, but mostly only weekends in NYC area
Maybe NYC area weekdays are better than weekends. Tokyo area you never wanted to drive. We had 3 toddlers in Tokyo, so sometimes we drove to avoid the hassle of transfers with small kids, even with traffic issues.