alt Hacker NewsIt was 2,000 concurrent agents at peak.
I'd still be surprised if that added up to "trillions" of tokens. A trillion is a very big number.
It was 2,000 concurrent agents at peak.
I'd still be surprised if that added up to "trillions" of tokens. A trillion is a very big number.
16 million a second across 2000 agents would be 8000 tokens per second per agent. This doesn't seem right to me.