They'll be just as useful as they are today. Which is plenty useful. Just like my 10 year old laptop is still useful. I could replace it, but why would I, it serves me well.
I just disagree, I don't think your 10-year-old laptop is very useful either.
It's like sure yea you can access the Internet and tinker around or whatever, and with some old LLM model you can have it do fun things, but on a scale of absolute usefulness and if we include what people actually pay money for and what is highly adopted, your laptop and model are severely outdated and by and large irrelevant. That's why the iPhone sells like hotcakes all day every day and twice on Sunday and Apple is a $5 trillion company. Society disagrees with your measure of usefulness.
Sorry I'm rate limited since Dang thinks I'm arguing to much on political topics (he's probably right), but to answer a couple of questions regarding "my old technology does this one thing" you are conflating your personal and nostalgic uses for old hardware/software with what is useful for society or business. If the old hardware was still just as useful as the new hardware it would be used instead of the new hardware.
>They'll be just as useful as they are today
I mean how useful are GPT-3 weights today? That's the kind of useful they'll be relative to the frontier.
I feel like the so-called "Deepseek moment" broke too many people's brains and they've lost the ability to reason about why frontier advantages matter. I think we have to learn some new core concepts and rate of improvement over time is going to be a big one, and not understanding that causes people to exaggerate the significance of downstream distillation that's done in response to it. It's cheaper and open and that matters, but it's not the kind of mattering that replaces the relevance or advantage of the frontier, and I feel like I'm not seeing people demonstrate that they know how to really compare the relative merit of these two things so much as zoom in on one to talk past the other.