alt Hacker NewsTokens can be sold at profit, but 70% of compute expenditure goes to R&D and model training[0]. Inference needs to cover all of that as well as being profitable in a vacuum.
Replies
benjiro3000 • today at 1:14 PM
[dead]
Tokens can be sold at profit, but 70% of compute expenditure goes to R&D and model training[0]. Inference needs to cover all of that as well as being profitable in a vacuum.
[dead]
this will change as inference demand increases (which is happening right now faster than many people expected)