The general fallacy of the “but inference is profitable” argument is that it tends to ignore all the costs of building and training the model. Given the fact that 1) that’s not trivial, and 2) the arms race underway means one can’t stop training, then it ruins the financial picture.
It’s like saying a new apartment building is “profitable” because the monthly income covers the monthly running costs, but ignoring the giant mortgage that covers the cost of building the building. That thinking is a good way to go bankrupt in real estate and a good way to go bankrupt in AI.
If the company who holds the mortgage wanted to own the building, they would have just bought it themselves. They don't, for whatever reason, so to some extent they have an incentive to help their customer succeed.
That's why it's so hard to get a residential mortgage, for example. It's more of a partnership, with more mutual vulnerability, than most people think. Same thing seems to be true here.
> The general fallacy of the “but inference is profitable” argument is that it tends to ignore all the costs of building and training the model. Given the fact that 1) that’s not trivial, and 2) the arms race underway means one can’t stop training, then it ruins the financial picture.
Or that it’s all hearsay and no one has released financials yet?