It would mean that inference is not profitable. Calculating inference costs show it's profitable, or close to.
Inference costs have in fact been crashing, going from astronomical to... lower.
That said, I am not sure that this indicator alone tells the whole story, if not hides it - sort of like EBITDA.
alt Hacker News
Inference costs have in fact been crashing, going from astronomical to... lower.
That said, I am not sure that this indicator alone tells the whole story, if not hides it - sort of like EBITDA.