> I can't imagine using a language without a good type system to catch all the junk the LLM produces

One approach would be to not use LLMs.