How will they make money on their product exactly? To the tune of being worth nearly a trillion dollars? There is no guarantee that inference will go down, we’ve seen some improvement with cheap models, but they aren’t what people want, and otherwise models stay expensive to run and use
Inference is already profitable (training is not)