LLMs are inherently deterministic. The way everyone deploys LLMs leads to non-deterministic results, but there's nothing† stopping providers from offering deterministic evaluation if they choose.

All the sources of randomness are under the control of the provider, even if today's deployment structures mean providers introduce extra randomness due to the concurrent nature of the evaluation. Serialise the computation, feed it from a pRNG, and you have a fully deterministic result. But providers don't want to offer a deterministic result, and especially not one as fragile, expensive, and inefficient as a full serialisation would be.

†: For variants of "nothing" that include cost and deployment challenges.

LLMs are chaotic pure functions. Their input is usually randomized.

There's deterministic enough, and then there's computer science non-deterministic. If I ask for a Todo app, I'm going to get a Todo app, even if the buttons get moved around and the background color of it is brown instead of purple if I ask today vs 6 months ago. If the AI completes the phrase "the capital of France is..." with anything other than Paris, something has gone more wrong than usual.