logoalt Hacker News

sudo_cowsay • today at 7:23 AM • 2 replies • view on HN

i thought open models weren't SOTA. therefore not neck and neck... in your experience, do you think it depends on your type of work?


Replies

ra • today at 7:28 AM

They're about half a gen behind. Very impressive to get this kind of utility from a flash series model... the impact of RL seems to be behind much of the coding and agentic improvements lately.

blntechie • today at 7:48 AM

In my experience, for coding, they are pretty much SOTA. Maybe not for other sciences and problem solving.