I at least didn't see this. I had a baseline evaluation from before Nov 3 on Opus 5.5 medium, so I re-ran it this morning.

Eval context: 30 bug fixes and features evaluated by tests the agent didn't see. Ran on Opus 5.5 at medium effort in Claude Code.

20 of the tasks were last run on Nov 1, twice each. Nov 1 solved 36/40, and today solved 19/20. Thinking tokens per task were 0.95x Nov 1’s and output tokens 0.97x. The one significant change was speed: median time to first token decreased from 3.0s to 1.7s.

Caveats: one run per task today, medium effort only.

I dunno there are some other nerf trackers that aren't showing a regression: https://github.com/ninjahawk/livenerf

I used to be skeptical of nerfing, but as of a week or so ago I've noticed a severe degradation of quality for GPT Astra. It struggled with very simple tasks, and it often failed to follow my instructions.

This happened last time too with Opus 5.5 (released September 22): https://news.ycombinator.com/item?id=49789224

idk, it hasn't felt nerfed at all to me, and it's not like i'm just doing trivial CRUD webapps either. opus 5.5 is very successfully porting my phone to postmarketos. claude just got the touchscreen up and working (and made a little program for me to test it, and it's legit).

I'm guilty of suspecting this.

If this turns out to be accurate, I think that would be a pretty unethical thing for Anthropic. Even if it is just a "we had to allocate compute to this new model release".

It should be fraud to swap out the model. We need a term for this, something like a bait-and-switch.

No they weren't. Models are not "nerfed".

I don't have a formal benchmark, but daily work (coding mostly, plus some complex architecture design and review) has had consistent outputs today for me. No noticeable nerf from my perspective. I definitely took notice in some past instances, but if they nerfed Opus 5.5, then I guess it was just so good that I was nowhere near its limits.

Cost per task

Fable 5.1 Max $11.46

Fable 5.2 Max $44.70

Can you share some evidence?

In a normal world you are not allowed to degrade the service during your agreed and paid contract. You would get sued. Apparently this is perfectly fine in this current world.

Benchmarks don't do a good job at capturing the difference in quality of frontier models over smaller models.

Opus 5.5 was so good that if it wasn't nerfed - at least just looking at the benchmarks - the difference in cost here does not seem to justify using this for anything besides design and review.

That's like maybe 1% of total token usage for SWE BUT a better design can have enormous benefits, so it's almost always worth using the best model for that.

> Damn people were right about 5.5 being nerfed in preparation for a version release. This is not at all a good look.

Anthropic does this time and time again, unserious company

No it’s not nerfed. Another poster said it the best, your dopamine receiptors are nerfed after the new model hype wears off

People have been complaining about how the models are nerfed non-stop for two years. A stopped clock is right twice a day.

yeah, we need to make sure we don't get stuck with these two evil corps. Dario is really the worst. Plays the drama queen but he is very hard in all things dark(i.e. dark patterns).

if this is their common practice, that's so shameful, nerfing before a new product release

But, it’s okay they do it because they charge less when it happens.

Right?

This has happened every single time for the past year, why are people surprised? This is all so that the new models can look better on the benchmarks.

for me opus 5.5 was acting kind of dumb, like forgetting basic stuff he was nailing last week

It's not true. People need to stop believing these conspiracy theories.

It's a good pattern to detect for perhaps.

I literally hit the desk with an open hand yelling I KNEW IT

Another reason we need to democratize local models.

I'm not surprised at all that they might be doing shady shit, my free request was used up in less than 7 minutes and said pay to continue, no thanks. I've paid for monthly before, never again I don't care how good the model is. I asked about the extreme limited usage in their discord and got banned, not a good look. You don't have a way to measure what you're actually paying for and they can change it at any time.

It gets worse. You might wonder "why now"? Well ... this happened 2 days ago:

https://x.com/follistatindev/status/2119129611510383014

With early handouts of Qwen4 starting to be reported 5 days ago ... so if they're good, they would have had some hours to evaluate Qwen4 against Claude 5.5 and, then or right after was when Anthropic decided to put out 5.2 ...

So yeah ... benchmaxxing and all that. BUT nevertheless, the published results seem to say that Qwen4-Max appears to match Opus 5.5 on some benchmarks, and Qwen4-27B (probably by going even harder than Qwen3.8-27B on thinking/inference time compute) can beat Sonnet 5.5 on some things.

I guess they're not taking any chances. Keep in mind that Anthropic has declared they have non-public models (it's in their IPO filing). These are referred to by the shorthand names Model 2, Model 3, and Model 4. Essentially 4 is better than 3 is better than 2.

Fable 5.2 is "2.5" so to speak. So Anthropic was holding back, but not anymore. And now they can dial the performance up once more with what they have ready, and probably once more after that.