logoalt Hacker News

jmalickiyesterday at 7:27 PM6 repliesview on HN

It does have access to its thoughts. This is literally what thinking models do. They write out thoughts to a scratch pad (which you can see!) and use that as part of the prompt.


Replies

fc417fc802yesterday at 7:58 PM

It's important to be aware that while those "thoughts" can be a useful aid for human understanding they don't seem to reliably reflect what's going on under the hood. There are various academic papers on the matter or you can closely inspect the traces of a more logically oriented question for yourself and spot impossible inconsistencies.

eleumiktoday at 1:15 AM

Those are a funny progress bar made by a micro model , is just ui

mmollyesterday at 7:48 PM

It doesn’t mean that these “thoughts” influenced their final decision the way they would in humans. An LLM will tell you a lot of things it “considered” and its final output might still be completely independent of that.

show 1 reply
grey-areayesterday at 7:46 PM

They do not in fact do that. The ‘thoughts’ are not a chain of logic.

sumenoyesterday at 9:03 PM

You have a fundamental misunderstanding of what the model is doing. It's not your fault though, you're buying into the advertising of how it works