> It helps to know that LLMs don’t “reason”. They predict ..
Semantics. Prediction is the training objective. The ability to reason can be, and very arguably is, an emergent property of that.
Even if that was true, you'd have to still prove it has emerged.
Maybe it looks like reasoning, and maybe that's enough for some.
Why would "reasoning" be an emergent property of prediction?
By that standard, human brains don't either. Our externalizations of concepts like language or symbolic structure allow us to do so. In the parlance of our times, we built our own reasoning harnesses because our intuition lead us to do so.