> on the other hand, the non-determinism is such a difficult problem to work around.

Well, you can always set temperature to 0, but that doesn't remove hallucinations.