logoalt Hacker News

8lamaster8last Friday at 5:48 PM1 replyview on HN

Nice explainer. One nuance I’d be careful with: “the brain doesn’t think in words” is broader than what the study seems to establish. The stronger result is that the natural-language network is not necessary for the kinds of inductive and deductive reasoning tested here.

The AI implication is fascinating though. We tend to build systems where the language model is simultaneously the language interface, memory, planner, reasoner and controller. Human cognition may be pointing in the opposite architectural direction: separate persistent state, reasoning/control mechanisms and language, then let language be one tool among several.

That distinction seems more interesting to me than simply asking whether LLMs “reason in language.”


Replies

lo_zamoyskiyesterday at 6:45 PM

One must be careful about what is meant by "language" here, which is actually language expression. LLMs don't possess conceptual content. They only operate on language expression.

Language as an internal conceptualization is still (obviously) essential to logical reasoning. The question of how language and logic relate can, therefore, concern either the internal language of concepts or the expressed language and its grammar, the latter of which is related to logic in that it reflects to some degree the internal language, but it is not identical with it.