Thats actually exactly on point; thing is, are programs deterministic? It depends; one can argue that any speculative execution pipeline cannot be truely deterministic from a timing perspective; its not an issue for a compiler, but it is for many applications. Gcc optimization flags were notorious to expose both compiler defects and non-deterministic code.

An LLM is a stochacstic system. With enough rounds, its undistinguishable from an emulated deterministic one, if you consider a delta greater than zero. Oh and each implementation/iteration give you the same determinism guarantees :)