logoalt Hacker News

impulser_ • yesterday at 10:40 PM • 0 replies • view on HN

I don't think it pre-training, because surely these labs all have similar data and Google should be very good at ingesting, cleaning, and filtering data.

I honestly think it just their post-training is fantastic and I think it has something to do with them being very opinionated on how they want the model to act that it basically the best at roleplaying a human. Humans are very good at completely and figuring out things that there aren't "trained" on if given basic set of intelligence. So when it working on these long tasks that might not be directly in it training data it still reason through it very well.

They got made fun of for this in the pass because they do a lot of research on this including hiring a philosopher.

This is just my best guess, because you don't see any other labs talk about how they made the model act and Anthropic is basically obsessed with it and talks about it every model release.

I think they just have better "taste" and that taste is their secret sauce.