> Musk (who freely admits to distilling OpenAI's models) struggle to build a competitive 1T model (Grok 4.5) with massively more compute (Colossus-1 100-250K GPUs, Colossus-2 500K+ GPUs)
Are you sure they are using all of their compute on training? Didn't they rent out a ton to other AI companies?
The renting out is a pretty recent development.