logoalt Hacker News

walthamstowyesterday at 2:00 PM1 replyview on HN

Meh, you probably would complain. Maybe you forgot you set it. Now your project is taking off, making money, and it got nuked.

Why aren't we talking about an EC2 - is that not a cloud compute service? People have been complaining about cloud billing since long before LLMs.

Anything to say about the technical problem of constantly monitoring many services against a project or account-level limit?


Replies

ChromaticPanicyesterday at 2:43 PM

You mean we can implement rate limiting on API for security purposes no problem but suddenly having it track costs as well is technically impossible?