alt Hacker NewsI wonder if something like this is the undisclosed new approach from Anthropic that presumably has massive improvements by combining multiple models. Leveraging decision models as much as possible seems logical for extra speed and token efficiency.
Replies
2001zhaozhao • yesterday at 8:53 PM
> undisclosed new approach from Anthropic
Any source on that?
pearcoder • yesterday at 8:50 PM
they do have the 'advisor' model setting now which also plays well with this
I think OpenAI and Anthropic have both been doing similar "routing" approaches for a while. Wasn't OpenAI one of the first to have a small model start responding to you for the first several tokens so that you got an instant response while the big model became available?
Similarly, Grok has been routing to Opus internally for a little while now I think.