5.6 Sol (max) being cheaper than all of these is wild, considering how good the output is too
I think on swebench verified luna was only like 3% points lower for 1/5 the cost
Like 96% vs 93% or something
Probably because they made ASICs to run inference for less.
This must be on API costs, not counting the $100/200 tiers, right?
It shouldn't be surprising OpenAI does have the most compute out of all the major labs. The only reason why Anthropic models are expensive is they are the most in demand models in the world and Anthropic is fighting for compute. The only way to you limit demand for your model is increasing API pricing this is also why Anthropic probably has great margin and probably is profitable compared to OpenAI.