> Pricing for both models is $10 per million input tokens and $50 per million output tokens.
The step-up in intelligence looks massive (we'll see in practice), but the price is getting to a point where it's making me question if it's even worth giving it a try.
Good competitors will probably be out soon, which should level the playing field. I am more excited about that, just the fact that they showed that such an improvement is possible. I'm okay waiting a bit longer for this to become attainable for plebs like me.
This is probably the end of 'use the best model no matter the price'
The pricing can be a bit deceptive though. A good model can deliver the same results in fewer tokens.
Kind of like billing a programmer by the hour.
Why wouldn't it be? How much would you pay a scientist at this point to think about a problem for you and give you a solution?
Models are getting better, but there's a negative change in terms of "productivity" per dollar. Yeah, I can throw 5 sub-agents at the problem, but the cost is getting significantly higher. And yes, I can crank out the solution much faster, but again, at some point that cost will be hard to justify. And it doesn't matter if the cost is subsidized by a provider, if it's paid by your company, or from your pocket. We are slowly reaching a point where the cost will be too high to justify the gains.