alt Hacker NewsDo you know everything that exists in public benchmarks?
They can give a description of what their metrics are without giving away anything proprietary.
Do you know everything that exists in public benchmarks?
They can give a description of what their metrics are without giving away anything proprietary.
I'd recommend watching Nathan Lambert's video he dropped yesterday on Olmo 3 Thinking. You'll learn there's a lot of places where even descriptions of proprietary testing regimes would give away some secret sauce
Nathan is at Ai2 which is all about open sourcing the process, experience, and learnings along the way