"An AI consultant tells Axios one of their clients recently spent half a billion dollars in a single month after failing to put usage limits on Claude licenses for employees." Like physically, how could this even happen?
Agents. An agent is a system for spinning up processes that use tokens, talking to other processes that use tokens.
I wonder how many megawatts that waste represented. Just one guy, worse than a small air force of private jets.
Now I understand the rumors of Anthropic starting to get profitable... by ralph looping fortune 500
This could happen with a large number of integrations or agent swarms working 24/7 with high throughput and long contexts.
Maybe the AI consultant gets a cut of that half billion?
Let's not forget about the environmental impacts. It's crazy that people are willfully burning so much energy for almost no return. And we thought bitcoin was bad... This is just completely irresponsible, if not sociopathic behavior.
I imagine some scenarios where you're throwing a big data set at an LLM could add up quickly.
"Check all of Confluence for outdated and conflicting info"
"Review all the legal contracts over the past 10 years"
"Evaluate the source code in all our dependencies for vulnerabilities"
All of those would be fairly straight forward for a single person to kick off without thinking about the data set size. Especially if they have Claude set to Opus 4.7 x high effort for everything.
Even someone saying something like "rewrite the 25 year old Java monolith in rust" as a PoC and leaving it running in the background for a week