How would you know?
How do I know my calculator is outputting the correct answer to a 10 by 10 digit multiplication problem?
It's an LLM. It is by definition smarter than you, and my shareholders know it.
How do I know my calculator is outputting the correct answer to a 10 by 10 digit multiplication problem?