logoalt Hacker News

nextaccountictoday at 4:03 AM1 replyview on HN

The thing that lets LLMs select the next token is probabilistic. This proposed a deterministic procedure

Problem is, we sometimes want LLMs to be probabilistic. We want to be able to try again if the first answer was deemed unsuccessful


Replies

foobarbecuetoday at 4:17 AM

Ah, LLMs. I should have guessed.