logoalt Hacker News

otabdeveloper4today at 2:43 PM0 repliesview on HN

It's simpler than that.

An LLM outputs tokens, one-by-one. It stops the loop if it outputs the end-of-text token. Which is, of course, statistically much rarer than any other kind of token.

(This is why you cannot, in general, prompt an LLM with something like "don't answer if the result is correct". It has to output something, by design.)