logoalt Hacker News

jrflotoday at 4:24 PM1 replyview on HN

sidenote, but wow sonnet 5 is shockingly bad on this benchmark.


Replies

notatoadtoday at 4:33 PM

sonnet 5 is bad by almost any metric.

anthropic really needs something to address the cheaper end of the market before they get left behind. Sonnet 5 sucks, and Haiku hasn't been updated in a year. meanwhile we've got gemini flash, luna, and GLM5.3 all delivering 90% of the performance for a small fraction of the cost. paying $25/mTok is going to start looking pretty silly soon.