Non-determinism is not inherently bad. We have had useful non-deterministic tools for (in computer years) several generations.

Non-determinism combined with bugginess?

That's a terrible combination. It is impossible to gradient-descent your way into a working prompt.