logoalt Hacker News

Gareth321 • today at 7:55 AM • 1 reply • view on HN

This reads like someone who tried Codex a few times with a blank system prompt and no context and came to the conclusion LLMs are dumb. All of those four examples are handled well by Opus 5.5. Especially with context and competent direction.

The worst part of his premise is that they can be overcome by increased intelligence. He’s not describing fundamental limitations. Meaning that it’s inevitable that his examples will be “solved.” At least better than humans. Meaning the R&D is obviously valuable.


Replies

fwlr • today at 8:01 AM

It reads to me like he’s using Astra. This is based on me reading the comment, and seeing him say he’s using Astra several times, eg:

  For example, I improved the SOTA on "listing all legal Scrabble moves" by 10x just by prompting Astra over and over to try harder, to aim for <specific performance level>, to "systematically try every method in the literature that seems kind of related," etc.
Perhaps you should instead say something like “This seems amenable to Stock Dismissal #4”.