alt Hacker NewsMixed signals, here it's performing below even GPT-5.4 Nano:
while here it outperforms Fable by a significant margin:
but if the latter is true, will people still say it was "distilled" from Fable?
Replies
Claims about Ox Alpha performing at Fable level were from the social media hype cycle. Everything new in the LLM space brings a wave of influencers hyping it up as a revolutionary leap forward. Don’t forget to like and subscribe to learn more.
It is a capable small model, but it’s not frontier level. The interesting part will be seeing the model size, how it responds to quantization, and how fast it runs on the kind of non-server hardware that we can buy without selling a kidney.
the 2nd website is not official, just something someone slopped together for some reason.
I really want to see hard evidence of distillation before I buy into it. Seems like a lot of sour grapes over not having the sort of lead assumed. In this field, it has been shown repeatedly that leaps in performance come swiftly and without notice.
GLM 5.3 was a great model, so this would be strange to release a regressed model
the outperform Fable was a mid (not completed) benchmark run. Real results were lower.
That benchmark is super sus. Until someone pointed it out, the top performing open weights model was a Kimi K3 fine tune from their sponsor (abacusai/Smaug-Agentic). Now, it's not on the list.
Source: https://twitterwebviewer.com/?tweet=2091116504787935350