There's a lot of nerds around the world. Plenty for a decent market.
Also it isn't this weird an idea. Could you imagine explaining to someone in 1995 that everyone would be chatting on a small touchscreen instead of calling each other on the phone? You'd be laughed out of the door "typing is not real communication".
Yet these days it's the main mode of communication. I do think AR/VR has a chance. Just not until the hardware is truly hassle-free.