I wonder how much of it can be blamed on the Vision Pro being nothing more than a big wobbly iPod Touch, instead of a real computer.
For me, a Vision Pro would have been fantastically useful if it was a little bit more like MacOS (or Android), and shipped with a native, real terminal that I could run things on. $3500 is suddenly a lot easier to swallow if I could think about it like 20 monitors to run terminals on.
The better analogy is that it's the Apple TV interface for your face. All the buttons are ginormous, the options are barebones, the information density is crap.