I'm surprised Sonnet 5.5 did noticeably better than Opus and Fable. Same pattern in their other benchmarks.
I like their benchmarks. They ask the right, not easy questions: https://surgehq.ai/blog/sudo-l7
Has anyone verified their figures to see if they hold up?
alt Hacker News
I like their benchmarks. They ask the right, not easy questions: https://surgehq.ai/blog/sudo-l7
Has anyone verified their figures to see if they hold up?