This is a big misconception. The core neighborhoods of the big Japanese cities are dense, mixed-use, and have good mass transit. But as soon as you move a bit further away, they degenerate into endless urban sprawl like American cities. I know because I live in a small Japanese city, and it is just box stores, small detached houses, and two-story apartments.