I work at OpenAI and I made the plots. Gemini 4 Carbon was omitted when we couldn’t find public data, usually cost. No intent to hide anything.
If we missed anything, feel free to point me to it and we can add it.
All TB-Science scores and Cost per Task (across all reasoning levels for Carbon) are on AA: https://artificialanalysis.ai/evaluations/terminal-bench-sci...
Would be great to see this on the plot as well
So all the plots are based off public data? You don't run the models internally yourselves?
(Again speaking only for myself)
Even OpenAI doesn't have access to Google's models
Sorry Ted but your plots suck. Just look at that first one, Agents' Last Exam v1.1. All the data points are overlapping on the left side. I can't even see what is what
> I work at OpenAI and I made the plots.
Have you not considered log scale for the "Agents' Last Exam v1.1" plot? Like this the left is so crowded I can't see a thing...