logoalt Hacker News

godbox • today at 9:42 PM • 4 replies • view on HN

What a snooze fest. Another model that does not meaningfully improve on intelligence or price compared to its peers. Google has basically announced that they've "caught up" with the rest. I think they've been doing great work in the Flash department so seeing this is... underwhelming?


Replies

piyh • today at 10:39 PM

> does not meaningfully improve on intelligence or price compared to its peers

$10 per million output tokens isn't improving on frontier price?

losvedir • today at 9:49 PM

The only models beating it are on "max", while this is "high". There's no guarantee that those effort / reasoning levels compare, but there's almost certainly an "xhigh" or "max" version later which will score higher there.

augment_me • today at 9:55 PM

I found that Google does not benchmaxx as much as the other providers. Of you look at real-case evaluation like lm-arena, even the 3.8 flash is often near the top despite its benchmark index being worse.

➕ show 1 reply
enraged_camel • today at 9:46 PM

Based on some... rumors I've heard, this is their "Pro" offering. There is supposed to be an Ultra coming as well.