logoalt Hacker News

mridulmalpani • today at 4:59 PM • 5 replies • view on HN

Gemini 4 Argon is a new leader in Pareto-frontier. Looks like, Google is back in the race.

https://arena.ai/leaderboard/agent/chat/pareto

For almost same intelligence (+15.56%, +15.18%), drastic difference in cost/task ($3.51 vs $0.41)


Replies

ianm218 • today at 7:26 PM

Why do these benchmarks often show models running on Max i.e. Opus 5.5 (max) is on the frontier? I would think it is never really economical to run max

➕ show 1 reply
cheema33 • today at 8:25 PM

> Gemini 4 Argon is a new leader in Pareto-frontier. Looks like, Google is back in the race.

For chat, yes. But switch to code on the same page, and the picture changes. OpenAI takes the lead.

vessenes • today at 8:04 PM

Muse reminded me we should have a time based chart as well - this year I hope we will begin to see time to completion stats at various intelligence tiers. The waiting makes a lot of things more tiring.

BrokenCogs • today at 6:22 PM

Every release I see a new benchmark with a new frontier. These graphs are just meaningless now

➕ show 2 replies