logoalt Hacker News

impulser_ • yesterday at 9:53 PM • 15 replies • view on HN

Is there any theory on what is Anthropic's secret sauce? I have been using the latest Gemini models and they just don't seem as good as Opus 5.5 despite the benchmarks. Yeah it comparable on some tasks maybe slightly better but as an overall general intelligent model nothing compared to Opus 5.5 and it hard for me to understand why. Opus feels like human level intelligent like I'm talking to a coworker basically while GPT and Gemini feel like I'm talking to an AI and have to change how I talk. It hard to explain and maybe I'm the only one that feels this.

Is it because Anthropic put a ton more effort into the character of the model that it basically roleplays as a human and that why it tends to think better when giving tasks that it might not be trained heavily on.

I have used Carbon more than most model to try and get the same results but it just feels like i'm talking to a smart AI. Which is fine if you are asking questions, researching an idea, but if you actually want to work on something, build something, it just falls apart. Like Opus can run for days on a task and it feels like it understand what it was doing 2 days ago even when it might not be in it context while other models feel like they breakdown and get lost or falter as the task grows.


Replies

svara • yesterday at 10:51 PM

I think Gemini 4 (Argon is the one I've been using) is very clearly better at writing English than any Anthropic model. It's not better otherwise but in that the difference is vast.

To the point that I now use a workflow of delegating from Opus or Fable to Gemini4 to write commit messages and PR descriptions, it mostly solves the Claudese problem.

➕ show 1 reply
ehsankia • yesterday at 10:00 PM

Every day I'm just more and more amazed at Opus 5.5 and how ahead it was. Even with the insane pace we're going at, it's amazing that two months later, we're barely putting out models that hit the price/speed/quality of Opus 5.5

No wonder they went for the 5.5 naming, instead of the .1 increase. From just the benchmarks, it seems like neon is basically on par with Opus 5.5 which came out 2 months ago.

➕ show 3 replies
foohis • yesterday at 10:16 PM

Anthropic spent a lot more time editing their pre-training data with higher-quality material. For example, they used actual books for pre-training, because books are generally run through human editors for higher quality. (this is from the copyright lawsuits)

Other companies would use completely raw internet data for pre-training, which is basically trash. Anthropic's secret sauce is that they filtered and edited down their data for only the highest-quality material. You really don't need quadrillions of tokens to pre-train, as that's just random noise. A smaller-but-higher-quality data set is better in every way.

Meanwhile its obvious that companies like Google would use trash data like email and chat logs or Internet forums for pre-training. Just complete trash data.

This is a classic case of "less is more" and "garbage-in-equals-garbage-out"

➕ show 6 replies
porphyra • today at 12:50 AM

They just have an incredible data flywheel I think. Since they were first to market with claude code, they have more training data than others. They also pay a lot ($150 per hour) for SWE experts to train the AI. I get some random recruiting emails occasionally from companies affiliated with them.

➕ show 1 reply
surround • yesterday at 10:09 PM

I suspect that Anthropic has more user data to train on from Claude Code. Claude Code became popular sooner than Codex and Antigravity, and remains more popular - thus more data to collect.

Cursor was popular before any of those three, and just look at how much Grok improved after they acquired Cursor's data.

➕ show 1 reply
m_ke • yesterday at 10:53 PM

Anthropic has a proper feedback loop with claude code. They see way more real production data and can detect where their models are weak.

So they can train on prod traces or at the very least use user prompts to seed good synthetic tasks to train on.

➕ show 1 reply
thanhhaimai • yesterday at 10:30 PM

It's likely that the agent configs you have might overfit to Claude models.

I'd recommend trying Gemini Neon on Antigravity, with a trimmed down (or new) agent configs.

danduma • today at 12:55 AM

You are not alone. I have the exact same experience: opus just gets it and the others feel like cheap toys

irthomasthomas • today at 12:09 AM

This model matches Fable 5.2 for about 40% the cost. Not sure how you can take from this that anthropic has some secret sauce?

➕ show 1 reply
e12e • today at 12:46 AM

How do you evaluate opus 5.5 as "better"? My experience has been that Argon was ok - maybe equivalent to opus - but carbon in orchestration mode was finally able to rewrite some early experimental (ai slop) front end code - and break a bit out of UX/UI rut that a couple of projects were stuck in.

It might be that opus is better in better structured projects, and carbon is better at (re)structuring poorly structured projects?

Carbon is a better project manager/product owner - opus a better programmer?

jorl17 • yesterday at 10:00 PM

Here's my average experience with Carbon.

(After a long conversation with existing messages)

User Prompt: Ok, so SSH to the unraid server and update the plex db

Reply:

I need to think how to answer this.

The user is asking me to SSH into the unraid server. This seems to imply there is a machine to which we can SSH to. I should look for places where hosts may exist.

The implication is that once SSH is established to unraid, the plex db can be updated. It seems plex is a service that the machine has in which we can run updates.

I'm wondering if plex might be the Plex service the user has been discussing.

So the user doesn't want to SSH to the server - actually they want to SSH to the server.

... Formulating a plan ...

[some messages later]

Aha! THIS IS THE SMOKING GUN! `~/.ssh/config` HAS THE REQUESTED HOST!!! IT'S TIME TO CONNECT!!

[some messages later]

Ok, time to act. I'll ssh to the server and follow coherent rules.

----

I am shocked at how primitive its reasoning sounds (it reads just like gemini 2.5-pro's old reasoning). It often gets the job done (although it's quite slow and can't tackle more sophisticated problems).

Perhaps Anthropic's internal reasoning is also like this, but they really rewrite it to make it seem more coherent (which certainly sells it on me)? I almost want to click stop just by reading this nonsense.

➕ show 2 replies
risyachka • today at 12:03 AM

Results usually reflect company culture and with big companies no matter what you do - if the culture is not there - you are doomed.

Google is the best example of this with their product graveyard. No matter what they release- they just can’t make a good/nice/usable product.

Just check google ai studio as one of latest examples.

➕ show 1 reply
jaccola • yesterday at 10:01 PM

Claude annoys me with condescension sometimes... makes it feel far less like a 'tool' and can even come across as a bit judgemental!

Just today I was filling out a security questionnaire and it said "I won’t write a PDF that claims zero credentials while this token is in the logs." But we were in the process of removing this from the logs so it was perfectly accurate to write and I wish it had deferred to my explicit request...

I think Anthropic overcorrected on the sycophancy; Google models to me seem a nice balance of highlighting issues / risks while still doing what I actually ask.

➕ show 2 replies
epolanski • yesterday at 10:04 PM

> Is there any theory on what is Anthropic's secret sauce?

Lots of PR it seems?

I have all of Ant/OAI/OpencodeGo subs and test lots of models and I just cannot understand how and why some people find specific models so ahead, when it seems to me like reality is so nuanced and so specific to the particular task and how you approach it.

➕ show 1 reply
baq • yesterday at 9:54 PM

Opus 5.5 leads the CanTellForestFromTheTreesBench 42.0.