Are you working on the same overall project or many separate projects? I find that makes a difference (entirely separate projects being more difficult for context switching of course).

Overall though, I wouldn’t buy too much into the hype of running 1000000x agents at once. The quality simply isn’t there yet IMO, hence the agent management overhead/tax we’re feeling.