logoalt Hacker News

A_D_E_P_T • today at 6:08 PM • 3 replies • view on HN

Wow. If those charts are true, this effectively matches GPT-6-Astra at a fraction of the cost, and is neck-and-neck with 6.1-Sol.


Replies

user43928 • today at 6:21 PM

Looks great on the first chart, but terrible on the Terminal Bench 4.0 where it needs xhigh to come close to 6.1 Sol, and costs more for a slightly worse result.

fallingbananna • today at 6:58 PM

I would guess only on the nitpicked benchmarks?

The pelicans place it nicely between Sol and Luna in terms of both pricing and results.

➕ show 1 reply
tristanj • today at 6:18 PM

Not necessarily, they may have selected benchmarks where Terra performs relatively well compared to those models. Pretty much every model release these days just cherry-picks & highlights the benchmarks where their latest model performs best. We'll have to wait for the complete benchmark suite to have a better picture.