If you’re using a very strict definition of open source that would be OLMo 2 I think?
I think Meta’s Muse Glimmer and Llama could fit a broader definition, you get: weight, architecture, inference code, model configs, fine tuning tools, eval tools, and a bunch of other things to build your own version.
Not an expert, I’m sure there are others, that’s the ones I’ve seen mentioned in discussions
If you’re using a very strict definition of open source that would be OLMo 2 I think?
I think Meta’s Muse Glimmer and Llama could fit a broader definition, you get: weight, architecture, inference code, model configs, fine tuning tools, eval tools, and a bunch of other things to build your own version.
Not an expert, I’m sure there are others, that’s the ones I’ve seen mentioned in discussions