You're not the first to have the idea. For languages that are only sparsely represented in the LLMs' training data, this has actually done a lot of damage. The LLMs spew out a bunch of hallucinations, and there aren't enough qualified human editors to review it, so the human record of that language itself becomes tainted.

https://www.technologyreview.com/2025/09/25/1124005/ai-wikip...