Inference costs aren't a problem, selling inference is almost certainly profitable. The problem is that its (probably) not profitable enough to cover the training and other R&D costs.
Don't forget all the other costs of their business, like paying sales and solutions people (expensive, not going away any time soon).
Don't forget all the other costs of their business, like paying sales and solutions people (expensive, not going away any time soon).