alt Hacker NewsYou do this to distill a model.
You can submit your users' questions async too, but if you do it sync, then you can also RLHF on the users' behavior after the output.
You do this to distill a model.
You can submit your users' questions async too, but if you do it sync, then you can also RLHF on the users' behavior after the output.
Ah, that makes way more sense than Anthropic's (probably deliberately misleading) insinuation that Moonshot has been burning millions of dollars in Claude API credits by swapping in a slightly better but infinitely more expensive model just to trick their users.
I get those A/B responses chatting in Gemini fairly often, and I really don't think I'd feel deceived if I later learned one of the choices was actually from a competitor's model.