They can also train models using this silicon. They're advertising 24T parameter models on their site right now.