alt Hacker News> Frontier models can probably not advance much further with the datasets we have currently available
I’ve been reading this sentiment on HN since GPT4o, yet models got better and better
Replies
willy_k • today at 6:17 PM
That’s because a significant portion of the work and spending going on at frontier labs is generating new, more curated data, in select domains like software engineering and now biology[1].
[1] https://www.synbiobeta.com/read/anthropic-is-hiring-biologis...
➕ show 1 reply
There’s a difference between things getting incrementally better and a step function.
LLMs will obviously keep getting incrementally better, but in order to get the kind on jump that LLMs themselves were, the sentiment is that we need something more.