A lot of bias here around non-extended theories of cognition.

We're already well past the point of trying to correspond the internal "brain chemistry" of an LLM to a thing called "reasoning". True reasoning, if there even is such a term, is very clearly, empirically and historically, based in tool use and capability use. If you create an abstraction like lean, and programming languages to brute force, and systems to integrate with, that expands what the possibility of "intelligence" is.

There's further places to take this including the claim that intelligence lives "outside" the subject - fine, we can or can't debate that. Even if we drop that question, it's pretty clear that the agent doesn't need to have deep intrinsic structures of XYZ, if it can just attach to tools and compose them to achieve results.

For example, I've said before that a well known fact of LLMs is that they steer their tokens to the right input distribution, that's why they yap so much in reasoning (this has been proven in studies). At the same time, don't mistake that for the whole process. Are they steering themselves to the entire a priori reasoning chain, or are they scaffolding with intermediate experiments and results, writing them to memory notepads, etc. etc.

That changes the metric of intelligence you're trying to measure.

And no I'm not saying, "OK, then have the LLM use only tokens, no tool calling, no nothing". I mean, we can do that, sure. But any intelligent agent has to interact with the world - and my claim is that maximally intelligent agents won't put effort into a priori reasoning, but rather a more balanced approach that outsources said "intelligence" through abstractions.