logoalt Hacker News

AnimalMuppet • today at 2:50 PM • 0 replies • view on HN

But it's different data. The human training bandwidth is dominated by physical things. There's a thing I see, and I move my hand and I touch it, and I hear the sound of the impact, and I feel the touch. And I learn how all those are correlated. I learn to build a mental map of the physical world that corresponds pretty well to the actual physical world, so that I can survive living in it.

LLMs are trained primarily on text. That trains them on relationships between words more so than correlation to the physical world.