logoalt Hacker News

bjournelast Sunday at 6:23 PM1 replyview on HN

LLMs work by generating the most likely continuation to a prompt. But they can also generate multiple likely continuations. This create multiple branches which in turn can generate even more branches. The LLM can then evaluate the branches, prune the unpromising ones, and merge the best ones. More branches means more tokens, means more effort.


Replies

simianwordslast Sunday at 7:05 PM

this has nothing to do with the thinking effort however

show 1 reply