logoalt Hacker News

AntiDyatlov • today at 4:03 PM • 0 replies • view on HN

LLMs are jagged in their capabilities. Opus 4.8 was already an excellent programmer, but it played Pokémon Red far worse than a human child, even if it did, eventually, manage to beat it.

I note that the dazzling events that have happened have all been in coding, cybersec, and math, that is, domains where the correctness of the work can be verified entirely inside the computer. It is unclear whether further progress along these lines leads to crazy scientific breakthroughs too, which is something people are taking as a given when it comes to superintelligence.