logoalt Hacker News

pattt • yesterday at 9:09 PM • 3 replies • view on HN

I don't get these "distilled" comments. How would one realistically go about distilling the 1-2TB closed source frontier model behind the oracle (provider) ? Just genuinely curious.


Replies

lurker137 • yesterday at 10:50 PM

In their thinking and if you ask them, I've seen Kimi K3 and other models confidently say that they are Claude from Anthropic, and accuse you of attempting to jailbreak them if you say otherwise.

redox99 • yesterday at 9:31 PM

When people say distilling they mean SFT on other models outputs.

coldtea • yesterday at 9:20 PM

They're cope, as if Anthropic or OpenAI have some magic moat, and not just basically a headstart and more money.

➕ show 1 reply