I want a new bench - given $100 of api spend, how much can a model accomplish for a suite of benchmark tests?

Give us something that measures a combination of efficiency and intelligence.

I think this would allow for some interesting tactics for smaller models - eg they could do things like computer use to test their results and grind on problems for longer to verify the outputs, whereas larger models may not have budget to self-test.