alt Hacker NewsEvaluation loops do this easily. You have to run hundreds of reasoning jobs in parallel and very quickly you can torch thousands of dollars.
Replies
sixtyj • today at 6:15 PM
Yup, run multiple agents on expensive model in loop via API.
You can do it if your employer has endless pockets.
Example: $30/1M input tokens (I don’t count output or cache, for simplification), you have several daily agents for everything => 3M tokens daily per agent * 10 agents ~> $900/day => $328k/year (API spending)
Yeah, it was basically this, and running a whole lot of agents concurrently to churn through the dataset faster.