logoalt Hacker News

foostertoday at 2:07 PM5 repliesview on HN

Where is your evidence of this "massive cost"? Inference is massively profitable for both anthropic and openai. Training is not.


Replies

kibwentoday at 2:17 PM

The evidence is that quotas exist, as seen here, and are low enough that people are hitting them regularly. When was the last time you hit your quota of Google searches? When was the last time you hit your quota of StackOverflow questions? When was the last time you hit your quota of YouTube videos? Any service will rate limit abuse, but if abuse is indistinguishable from regular use from the provider's perspective, that's not a good sign.

show 2 replies
weakfishtoday at 2:43 PM

This article convinced me otherwise https://www.wheresyoured.at/the-subprime-ai-crisis-is-here/

show 1 reply
scrolloptoday at 2:17 PM

The majority of accounts are free - these are profitable?

IMO they need as many users before their IPO - then the changes will really begin.

quikoatoday at 3:11 PM

Inference for API or subscriptions? There is a massive price difference between the two.

wesammikhailtoday at 2:11 PM

source?

show 1 reply