alt Hacker News> with temperature at zero, for the same input they produce always the same reply.
Nonsense.
https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
> with temperature at zero, for the same input they produce always the same reply.
Nonsense.
https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
BS. Run them sequentially on a single core, and without fancy speedups enabled, and they do. The algorithm is determinstic. Any non-determinism present with 0 temperature it's not some mysterious LLM-inherent property, but something that can be seen in any large program taking advantage of multi-core, floating point, and other CPU-based parallelism optimization.