alt Hacker NewsI think the "secret sauce" is not juicing the benchmarks. Claude models just feel like they are better than the benchmarks suggest, in terms of smarts and creativity, while models from every other company feel worse relative to what you'd think from the benchmarks. Only company to really internalize Goodhart's Law, IMO.
Yeah every model has great benchmarks. Claude is the only model I want to use when I'm not worried about the marginal cost of tokens (which is most of the time at work.)
I then use cheaper models like GLM for personal projects but they're noticeably much worse despite being similar in benchmarks.