> It sometimes feels like the only thing saving LLMs are when they’re forced to tap into a better system like running a search engine query.

This is actually very profound. All free models are only reasonable if they scrape 100 web pages (according to their own output) before answering. Even then they usually have multiple errors in their output.