logoalt Hacker News

gavinray • today at 5:19 PM • 8 replies • view on HN

Benchmark scores recolored for readability:

https://i.imgur.com/IDFGuJU.jpeg


Replies

philrenaud • today at 5:54 PM

Serendipitous timing, but I've been building a little chrome extension [0] for doing exactly this sort of thing (highlighting tables automatically, especially when numbers don't necessarily correlate good=green, bad=red). Model pricing and comparisons are one of the main things I checked (low cost good, high benchmark score good).

[0] Practical Data (https://practicaldata.dev/ / https://chromewebstore.google.com/detail/practical-data/oeoo...)

loeg • today at 7:12 PM

Huh. Do people actually find that Fable-5.1 is worse than Opus-5.5 for any task?

➕ show 5 replies
tidbeck • today at 5:43 PM

Zoomed on the image and Imgur now also requires an app…

➕ show 3 replies
jsphweid • today at 5:46 PM

On one hand this looks like a joke?

On the other hand I'm a strong protan colorblind guy (red doesn't register to me very well at all).

➕ show 1 reply
no-name-here • today at 6:39 PM

Thanks.

Also, I'm curious if you just asked an AI to _OCR the original image+update it_, or if you used a different process?

gradus_ad • today at 6:46 PM

What is SWE-Sweep?? Shocking to see such poor evals.

varispeed • today at 6:48 PM

Imgur is not available in the UK due to censorship.

alienbaby • today at 6:12 PM

am i missing something or have they updated the page? the blue highlights and grey arent that bad to read?