alt Hacker News...the evidence, as best I can tell from the tweet, is that they asked Claude what effort level it was set to. But how would the model even know that?
Not convinced here.
Replies
jerbear4328 • today at 5:39 PM
Effort level is actually controlled entirely by system prompt (as I understand it, the model is trained on that format but still), so actually this is a valid way to check I think
➕ show 1 reply
varispeed • today at 5:56 PM
Then model can say it's Opus, but really it is some old Sonnet. This seems to be happening less often, but some weeks ago I had to give models some test problems to gauge whether I am getting Opus or something knee-capped.
The problem is that Anthropic seems to be getting away with selling one thing and delivering another. You pay for Opus, you get something else etc.
➕ show 1 reply
I don’t know if this is still the case but while using Copilot if you looked through the chain-of-thought output you would see it reasoning about a “budget”. i.e. “since I’m close to the session budget I should…”. So it could be possible