logoalt Hacker News

applfanboysbgontoday at 1:31 AM1 replyview on HN

> AI is stochastic, not static and deterministic.

LLMs are deterministic. If you provide the same input to the same GPU, it will produce the same output every time. LLM providers arbitrarily insert a randomised seed into the inference stack so that the input is different every time because that is more useful (and/or because it gives the illusion of dynamic intelligence by not reproducing the same responses verbatim), but it is not an inherent property of the software.


Replies

digitaltreestoday at 7:20 AM

The same argument is made about the human neural network

show 1 reply