logoalt Hacker News

MattDaEskimotoday at 1:05 PM2 repliesview on HN

How is it misleading if this would be the consumer's cost?

Eventually Codex's subscription subsidization will diminish to near-zero, like the rest of the providers.

It's extremely important that people understand how expensive these models currently are. Even $300k in raw API costs is alarming for the output.


Replies

pamatoday at 1:30 PM

Peter shows the near-term future. Raw API consumer price cost is arbitrary. (The frontier labs can put a 100x markup to cover other operational expenses.) The true cost of inference with same-capability models keeps dropping at dizzying rates, especially at the data-center batch size. (Due to both NVidia hardware and algorithmic changes.) So the developments that Peter can achieve today with internal support from OpenAI will be doable by anyone in a few years without breaking the bank.

show 1 reply
namenotrequiredtoday at 1:17 PM

> How is it misleading if this would be the consumer's cost?

Because it does not say “equivalent of”, it literally says he spent money that he did not spend

show 1 reply