alt Hacker NewsNo, LLMs ARE deterministic, just like all computer programs are.
I get why that is in practice different then the manner in which compilers are deterministic, but my point is the difference isnt because of determinism.
No, LLMs ARE deterministic, just like all computer programs are.
I get why that is in practice different then the manner in which compilers are deterministic, but my point is the difference isnt because of determinism.
I think you are misunderstanding the term "deterministic". Running on deterministic hardware does not mean an algorithm is deterministic.
Create a program that reads from /dev/random (not urandom). It's not determistic.