logoalt Hacker News

CobrastanJorji • today at 5:29 AM • 0 replies • view on HN

As an aside, I do not like unnecessarily misleading graphs. Own your strengths and weaknesses.

In the "Results" section, they choose to compare Ultramarine only to models that it's better than on every metric. They ignore models like Fable 5.1, GPT-6 Astra, Claude Opus 5.5, etc.

Then, in the "Score against cost per task" graph, which is focused on price, suddenly all of those models that perform better than Ultramarine come roaring back because they are also more expensive.

Just list yourselves as the second best sometimes. Your thing is impressive. Don't let the idiot marketing guy hide that behind stupid tricks.