logoalt Hacker News

extraduder_ire05/15/20251 replyview on HN

Are there any stable output large language models? Like stablediffusion does for image diffusion models.


Replies

tibbar05/15/2025

If you use a deterministic sampling strategy for the next token (e.g., always output the token with the highest probability) then a traditional LLM should be deterministic on the same hardware/software stack.

show 2 replies