Then it's pretty bad that LLMs don't understand anything.

They don't know and can't know. Without an external source of input that corrects them, their output can never be verified.