logoalt Hacker News

dymkyesterday at 11:32 PM2 repliesview on HN

The weights are the output artifact, the training corpus and system are the source.


Replies

culiyesterday at 11:45 PM

Kimi publishes their code and a technical report on their methodology. But I think the weights are still important. It means anyone with the resources could run the same model on their own hardware.

charcircuityesterday at 11:53 PM

The training corpus + training code is just an automated editor for the weights. It would be like requiring the source code for Visual Studio for software made within it to be open source.

Weights are not an output artifact no more than source code is. There is never a moment where you can claim that it's done. As requirements change new ways to change the weights / code come up. With different projects you might want to import the weights / code into a bigger model / codebase.