alt Hacker NewsFable is strongly believed to be around 10T. The most conservative estimate I've seen is 8T.
Eg: https://www.reuters.com/technology/bytedance-targets-mega-ai...
That reports Mythos as 8T and Fable as 5T, but I think they mean Opus as 5T, which is widely known, eg: https://eu.36kr.com/en/p/3760679047267075?ref=explainx
Both Grok and Bytedance are training 10T models.
Replies
andai • today at 5:21 AM
Wasn't Opus ~1.5T and Fable is about twice that?
The fact that Musk claims Opus is 5T to justify why Grok is far behind should be taken with a massive grain of salt given he's a recidivist mythomaniac.
Honestly if Opus is 5T parameters while being matched by the biggest open models that are at least twice smaller, it would mean that the US is already behind China in the AI race, despite a significant edge in compute.