I'm glad to see some development in the space of "truly open" models that share training data and other recipes. As the costs for hardware fall over time (hopefully), we should see more possibility in fine-tuning and developing software to inspect the source training material.

Some other open models I'm aware of:

   - OLMo
   - Apertus
   - Soofi
   - OpenEuroLLM
   - llm-jp

OLMo is perhaps the most famous, and their Dolma training corpus has been reused in other projects. It looks like the K2 training materials haven't been released yet, but I'm interested to see what they did for training "long-horizon agentic tasks". I'm aware of SWE-smith + SWE-gym but I'm guessing there's a lot more out there now.

I'm no expert, which is part of why these projects excite me. I'm hoping they can be good projects to learn from as well.