Wrote about this awhile ago, and it hasn’t changed:

> Time and time again, when talking to people who rely on ChatGPT, Claude, Perplexity, and other general AI tools, I hear them say, “AI is incredible. It handles nearly everything I throw at them.”

> “What does it fumble with?” I’ll ask.

> “Well, it still gets things wrong when it comes to my line of work.”

https://www.dbreunig.com/2025/04/08/on-ai-observational-comi...

I thought of the "does he know" meme when I saw this.

It's the kind of overstated unjustified claim an LLM would make.

Gell-Mann Amnesia. Recognises the failings in their own field of discourse, assumes all true about anything else, same source.