alt Hacker NewsIt is an important distinction - they do not 'understand' at all.
Input tokens map to output tokens. The illusion of comprehension is a byproduct.
It is an important distinction - they do not 'understand' at all.
Input tokens map to output tokens. The illusion of comprehension is a byproduct.
I’d argue if an illusion is indistinguishable from the real thing, then it stops being an illusion.
It’s a mapping, yes, but a very large, complex mapping. It’s clear LLMs do understand some things and can reason. How that’s done we don’t know, it’s emergent. It’s not like you can pin it down to a specific mapping.