Gemini 4 Argon is a new leader in Pareto-frontier. Looks like, Google is back in the race.
https://arena.ai/leaderboard/agent/chat/pareto
For almost same intelligence (+15.56%, +15.18%), drastic difference in cost/task ($3.51 vs $0.41)
> Gemini 4 Argon is a new leader in Pareto-frontier. Looks like, Google is back in the race.
For chat, yes. But switch to code on the same page, and the picture changes. OpenAI takes the lead.
Muse reminded me we should have a time based chart as well - this year I hope we will begin to see time to completion stats at various intelligence tiers. The waiting makes a lot of things more tiring.
Every release I see a new benchmark with a new frontier. These graphs are just meaningless now
Why do these benchmarks often show models running on Max i.e. Opus 5.5 (max) is on the frontier? I would think it is never really economical to run max