alt Hacker NewsFor $10 flat per request up to 128k tokens they’re losing money. 100 * 100k is 10m tokens. At current api pricing that’s $50 input tokens, not even accounting for output!
Replies
everfrustrated • yesterday at 8:55 PM
You didn't account for cached input tokens - some % of input tokens will be follow-on prompts which are billed at the cheaper cached token rate.
indigodaddy • yesterday at 8:07 PM
I mean aren't they losing money on everything even the API? This isn't going to end well with how expensive it all really is.
➕ show 2 replies
And a request can consume more than 128k tokens.
A cloud agent works iteratively on your requests, making multiple commits.
I put large features into my requests and the agent has no problem making hundreds of changes.