alt Hacker NewsYes! Impressive, isn't it? I see how it has improved for some minor points, that the big models can cover more finetuning ground, but my big gripes are still the same - you could do the same back then with multiple models and more targeted finetuning.
Replies
I have no idea how you could try and hold this argument without being facetious.
This is obviously not true to all of us here…
> you could do the same back then with multiple models and more targeted finetuning
I mean, come on, this is just not true. You could not achieve anything like what you can with modern agentic coding with Fable / 5.6 Sol from any combination or configuration of GPT 3.5 era models.
It's like saying that a teenager isn't an intellectually meaningful improvement over a toddler.
Sure they're both still fundamentally flawed humans prone to cognitive error, but one is clearly more likely to hit the mark than the other when assigned a task.
Utter nonsense.
There’s no way you could get models as smart by fine tuning. I couldn’t throw a problem like “build a pokemon database with UI to teach my son sql” and get a working system, nice ui, tests (which it iterated on) examples and explanations in one shot.
There weren’t thinking tokens. Maths is now dramatically better, making actual contributions when before they were mostly mocked for making extremely basic errors. Smearing is also something say is very rare in frontier models.
If you think they have barely changed you’ve either forgotten what they were like or not used them more recently, or you’re just being obtuse.
> you could do the same back then with multiple models and more targeted finetuning
Are you one of those anonymous billionaires as if you did this a few years ago, you would've been famous and rich.
> you could do the same back then with multiple models and more targeted finetuning
Definitely not, lol.