logoalt Hacker News

declanjackson • yesterday at 10:05 PM • 7 replies • view on HN

Something that is interesting is how it's positioned in the overall fleet of Gemini models. Although overall more Intelligent than Carbon, Carbon is still positioned as the 'long horizon' model. This is clear on AA Index, where we see higher overall scores for Neon but lower scores in evals like CritPt which test research-scale reasoning capabilities.

With the frontier getting more jagged, we might see more of this 'less intelligent overall but useful for the frontier tasks'-type models, meaning picking a model will only get more difficult from here.

(FD: I work at AA)


Replies

GodelNumbering • yesterday at 10:35 PM

> (FD: I work at AA)

I do apologize in advance for putting you in spot like this, but there are two things I have been quite curious about.

1. Since 60% of the benchmarks contributing to AA are now private only, how do you guys ensure transparency? More precisely, how can someone verify the transparency in scoring?

2. There are also disclosures about custom benchmarking services offered to AI labs, what does AA do to keep the custom benchmarking services not getting access to the same/similar data that is used in the private benchmarks?

seizethecheese • yesterday at 10:46 PM

Okay, this "better at long horizon tasks" thing might explain why Carbon scores worse on most benchmarks yet is the larger model.

I looked into this using data I have from a battle system built on top of OpenCode (so we're trying to capture real world use). It looks like Carbon actually does a lot better when it uses significantly more output than opponents.

Win rate when output is less than 2.5x opponents: 53% (41/78)

Win rate when output is more than 2.5x opponents: 73% (41/56)

The p-val on this is 0.02. Data from https://agentduel.com/leaderboard.

There doesn't seem to be any relationship between actual size of task though. Win rate appears random based on total output of Carbon and also opponents. (Though our data is still small, so it might exist.)

Looks basically like Carbon was trained to think a lot longer, not necessarily that it's better on large tasks.

abixb • yesterday at 10:07 PM

Yes, I feel the next differentiation in model capabilities would be wrt how 'long of a horizon' goal they could autonomously work toward without breaking. We're in need for a new generation of evaluations and benchmarks for this -- METR doesn't cut it anymore.

seizethecheese • yesterday at 10:12 PM

That would clear up why Carbon is such an outlier in terms of output tokens per task.

WarmWash • yesterday at 10:23 PM

Neon is probably distilled from Google's internal successor to Carbon.

drivebyhooting • yesterday at 10:11 PM

What we need is a model that automatically delegates intelligently (via RL and benchmaxxing?) so I can be freed of this burden.

➕ show 5 replies
mi_lk • yesterday at 10:25 PM

what's AA

➕ show 2 replies