Of course there is, restrict decoding to allowed tokens for example

Natural language is ambiguous. If both input and output are in a formal language, then determinism is great. Otherwise, I would prefer confidence intervals.

That is "fundamentally" not true, you can use a preset seed and temperature and get a deterministic output.