logoalt Hacker News

blazinglyfasttoday at 2:37 PM1 replyview on HN

> even if it was deterministic (which you can technically make it to be I guess?)

No. LLMs are undefined behavior.


Replies

xixixaotoday at 2:42 PM

OP means “given the same input, produce the same output” determinism. This isn’t really much different from normal compilers, you might have a language spec, but at the end of the day the results are determined by the concrete compiler’s implementation.

But most LLM services on purpose introduce randomness, so you don’t get the same result for the same input you control as a user.

show 2 replies