logoalt Hacker News

dan_mctreeyesterday at 10:33 PM1 replyview on HN

>So obviously, error correction with inputs/outputs is not the way we get to intelligence.

This doesn't seem to follow at all let alone obviously? Humans are able to reason through code without having to become a completely discrete computer, but probably can't reason through any length of assembly code, so why is that requirement necessary and how have you shown LLMs can't achieve human levels of competence on this kind of task?


Replies

ActorNightlyyesterday at 11:04 PM

> but probably can't reason through any length of assembly code

Uh what? You can sit there step by step and execute assembly code, writing things down on a piece of paper and get the correct final result. The limits are things like attention span, which is separate from intelligence.

Human brains operate continuously, with multiple parts being active at once, with weight adjustment done in real time both in the style of backpropagation, and real time updates for things like "memory". How do you train an LLM to behave like that?

show 1 reply