logoalt Hacker News

swader999today at 12:05 PM6 repliesview on HN

"An AI consultant tells Axios one of their clients recently spent half a billion dollars in a single month after failing to put usage limits on Claude licenses for employees." Like physically, how could this even happen?


Replies

nijavetoday at 1:55 PM

I imagine some scenarios where you're throwing a big data set at an LLM could add up quickly.

"Check all of Confluence for outdated and conflicting info"

"Review all the legal contracts over the past 10 years"

"Evaluate the source code in all our dependencies for vulnerabilities"

All of those would be fairly straight forward for a single person to kick off without thinking about the data set size. Especially if they have Claude set to Opus 4.7 x high effort for everything.

Even someone saying something like "rewrite the 25 year old Java monolith in rust" as a PoC and leaving it running in the background for a week

pjc50today at 12:14 PM

Agents. An agent is a system for spinning up processes that use tokens, talking to other processes that use tokens.

I wonder how many megawatts that waste represented. Just one guy, worse than a small air force of private jets.

frangonftoday at 1:19 PM

Now I understand the rumors of Anthropic starting to get profitable... by ralph looping fortune 500

layer8today at 12:23 PM

This could happen with a large number of integrations or agent swarms working 24/7 with high throughput and long contexts.

ludicrousdisplatoday at 12:32 PM

Maybe the AI consultant gets a cut of that half billion?

spacechild1today at 12:51 PM

Let's not forget about the environmental impacts. It's crazy that people are willfully burning so much energy for almost no return. And we thought bitcoin was bad... This is just completely irresponsible, if not sociopathic behavior.

show 1 reply