logoalt Hacker News

onlyrealcuzzo • yesterday at 10:03 PM • 1 reply • view on HN

Fable & Opus, Astra & Sol, and Carbon are all thought to be >1T param models - AFAIK, most people think Opus & Sol are ~5T param models and Astra, Fable are 10T+.

I think the rumor-mill consensus is that Google's models are significantly smaller while attempting to swing at the same level - but the ratios AFAIK are thought to be around the same - i.e. Neon is somewhere around half as big as Carbon, big enough that a newer checkpoint can make it temporarily a little bit better.


Replies

ml-anon • yesterday at 10:24 PM

So many figures and ratios pulled from a single ass