alt Hacker NewsThis is always the first response to criticism of LLMs, and it's starting to feel banal, because it's a counter that you can pull reflexively from your back pocket at any time without engaging with the actual content of the criticism. I'm not saying it's wrong necessarily, but rather that the added information value of "have you tried GPT Cosmica 15" in a discussion on LLMs is approaches zero. Because it's such a generically applicable response.
Well, it's just a rephrasing of "I don't share this experience at all."
And it's an easy explanation for why one person can be getting "confidently wrong" results still, and another person hasn't experienced it in a long time.
I'm one who hasn't experienced it lately. I haven't even thought about it in quite some time. Maybe a domain thing, maybe I'm not doing fancy enough work, maybe that guy is using some shitty model.