Or now, Anthropic will distill the knowledge from this engine and optimize their inference.
The top quality frontier models are used to compress / improve the earlier, lesser models, to make them more efficient. So that pushes costs way down on previous models.
alt Hacker News
The top quality frontier models are used to compress / improve the earlier, lesser models, to make them more efficient. So that pushes costs way down on previous models.