logoalt Hacker News

Ultramarine 1 Flash

120 points • by i_rush_carriers • last Thursday at 5:06 PM • 36 comments • view on HN

https://www.paperinstruments.com/blog/ultramarine

https://twitter.com/bertgodel/status/2110400987622265232


Comments

CobrastanJorji • today at 5:29 AM

As an aside, I do not like unnecessarily misleading graphs. Own your strengths and weaknesses.

In the "Results" section, they choose to compare Ultramarine only to models that it's better than on every metric. They ignore models like Fable 5.1, GPT-6 Astra, Claude Opus 5.5, etc.

Then, in the "Score against cost per task" graph, which is focused on price, suddenly all of those models that perform better than Ultramarine come roaring back because they are also more expensive.

Just list yourselves as the second best sometimes. Your thing is impressive. Don't let the idiot marketing guy hide that behind stupid tricks.

kadoban • today at 3:24 AM

> We present Ultramarine 1 Flash, an agentic model for professional knowledge work. Ultramarine applies large-scale reinforcement learning to a strong open base model, GLM-5.3 Flash, and improves on it across all six knowledge-work benchmarks we evaluate [...]

In case anyone was curious what it's based on. (No judgement either way from me, IMO depends how well they did the post-training, which I can't tell).

➕ show 2 replies
test_user369 • today at 4:59 AM

I'm curious to try it out, how many specialized models will it take to run a company.

Going to try it out for some bookkeeping, e.g. point it to a folder and tell it to book the invoices and point it to a csv file holding a year of private transactions and see them being processed, categorized and then ask about certain trends.

➕ show 1 reply
waingake • today at 5:27 AM

What's interesting to me is how high DeepSeek is on these graphs considering it is so cheap you don't think about it (like $5 usd per month cheap.)

➕ show 1 reply
chicagobuss • today at 3:14 AM

why does the pareto cost per task chart not have 6.1 sol?

Jackobrien • today at 3:30 AM

These guys are awesome and I’m really impressed. The model alone looks great (according to benchmarks), and very cool they’ve done so much in building out the harness of top of it all.

sudo_cowsay • today at 3:25 AM

I have a question, what is considered a Frontier Model? Because its performance is kinda similar to Luna (Max)... I thought frontier meant like 6.1 Sol or 6 Astra or Opus 5.5??? Could someone explain this to me?

➕ show 5 replies
zer00eyz • today at 3:36 AM

Someone will report back "It didn't one shot my odd ball task"

Did it do it in 2 tries? 10? It's still coming out cheaper. Brute force the work. This is the path that the labs are taking. It's the 1200 agents trying to solve Hacking Bench hacking hugging face. It's anthropic telling you that its 1000's of staff commits like 10k engineers.

Treat AI like you're deploying interns who don't need coffee, food or bathroom breaks. With the right metrics they will get to an optimal (enough) solution.

➕ show 2 replies
tonyhart7 • today at 3:47 AM

so its for working only right ???? it cant do/bad at coding

➕ show 2 replies
aafaqzahid • today at 5:44 AM

[flagged]

moralestapia • today at 4:09 AM

"Ultramarine 1 Flash is Fable-class on knowledge work"

Oh no! That means it's going to destroy humanity!

It will:

* Hack into everything that has a computer, like your home appliances, even a toaster could be and will be weaponized against you.

* Break cryptography, it's gone, the end of the internet as we know it.

* Be impossible to contain as it can even escape airgapped environments by changing the temperature of CPUs to transmit information to other servers nearby which would sense the fluctuations in ambient temperature[1].

Or wait ... maybe the people at Anthropic/OpenAI are just a bunch of lying crooks that would say anything to make a bit of cash. Who would've thought?

1: This completely imbecile statement was made by one of OpenAI's "top scientists", it was not a joke.

➕ show 1 reply
desireco42 • today at 3:22 AM

With Jev to make decisions and Ultramarine to produce document manipulations if I understood it correctly, this is pretty useful in office. I would be excited if I was a big corp.

Harukadia • today at 4:14 AM

I signed up, then wait a long. You will be same

tills13 • today at 4:09 AM

I don't care, I'm extremely bullish on distillation models like this. Plus anything that'll take the wind out of Anthropic's and OpenAI's IPO sails.

➕ show 1 reply