> LLMs are not trained to produce true output; they are trained to produce likely output.

That is not what google search is promoting. They claim to be search. That is not what AI companies are promoting and selling.