logoalt Hacker News

mmollyesterday at 7:48 PM1 replyview on HN

It doesn’t mean that these “thoughts” influenced their final decision the way they would in humans. An LLM will tell you a lot of things it “considered” and its final output might still be completely independent of that.


Replies

jmalickiyesterday at 9:41 PM

Its output quite literally is not independent, as the "thinking tokens" are attended to by the attention mechanism.