logoalt Hacker News

shunia_huangtoday at 6:09 AM1 replyview on HN

But Dario said (and maybe more ppl) that Chinese models are just distillation of their model and training data, so I guess your first point is invalid?


Replies

traceroute66today at 10:58 AM

> But Dario said (and maybe more ppl) that Chinese models are just distillation

"But Dario said" ... yawn.

I am increasingly convinced that "they distilled us" is as much US FUD as "it was made by communists". Especially since its mostly the US tech-bros who are coming out with that tiny violin.

People telling me the Chinese models are distilled just because it says "I am Claude" when asked is also lame.

I am not the only one, look at this post on interconnects about Kimi K3 for example:[1]

     It should be clear looking at this model that if adversarial distillation from the closed frontier models in the U.S. contributed, it is at most to a relatively small degree. AI observers who followed the distillation panic and came away with the wrong conclusion that Chinese AI labs are only producing good models due to IP theft are in for an awakening – that Chinese companies are extremely good at building models in the same way the leading American companies are.

[1] https://www.interconnects.ai/p/kimi-k3-the-open-weights-esca...
show 1 reply