alt Hacker NewsLLMs are determistic. Just like everything else computers are capable of doing.
Commercial front-ends just hide the random seed parameters.
Replies
kortilla • today at 7:22 AM
Distributed float math is not deterministic without introducing total operations ordering and destroying performance
It's not usefully deterministic in the way computers usually are. Sensitively identical input can still lead to wildly different outputs even if all randomness is crushed out.