Have I been living under a rock, or this feels out of nowhere from Meta?
Seems they’ve just messed around with cheap and open weight models for years.
Then Muse appears, followed by full suite of frontier models…
Unlike everyone else, which at least has to pretend not to train on user data, they gave out their model for basically free if you agreed to let them train on it. Opencode shows nearly 40 trillion tokens going through muse spark 1.3 contributor this week alone. That almost definitely helped close the gap a lot.
they started their massive ai capex over a year ago with aquihiring scale ai, so I think it makes sense that their investment is paying off now. in total they've spent in the high 200 billion on ai, though I think most is likely on datacenters.