I'd kindly suggest that we could also stop calling them "distillation attacks".

False dichotomy right?

Are Chinese labs impressively innovating? Clearly.

However this doesn’t rule out possible gains due to distillation.

I don’t know the degree of the latter but both things could certainly be true.

You can’t build a frontier model with one single thing. This is an incremental improvement but it doesn’t explain the entire success of the model. The training set is immensely important, regardless of how you feel about distillation.

I stil don't understand them. I want the US to "win the AI race" but I have trouble understanding how most of all inventions today aren't "distillations" of past knowledge. Is Anthropic claiming the data they stole as trade secrets?

The distillation complaints to me sound like when a casino complains about card counting

Does one have to exclude the other?

Well said.

The distillation theory does not even make sense as Fable was only around for days (effectively) before Kimi was released.