logoalt Hacker News

mrweasel • today at 10:54 AM • 3 replies • view on HN

I can't read the original Chinese text, but if it's revenue, then you still can't say anything about profitability. Housing and powering one GPU should be way less than $38 per hour, so there should be a profit on inference. If that profit can cover training new models we don't know, but it would appear to not be the case.

For the past year or two I think it has generally been agreed that inference is profitable, but the LLM business as a whole is not.


Replies

v9v • today at 11:47 AM

I seem to recall the leaked Liang Wenfeng speech gave a figure of 8-12(?) months of inference recouping the training costs of the model.

➕ show 3 replies
laylower • today at 1:06 PM

What about sourcing the asset itself? It's like a factory is it not?

You pay for the asset (tenancy in a data center) and then you pay for housing, powering, cooling, etc.

sylware • today at 11:24 AM

Unless the money of the investors is going somewhere else...