Only for about five more years. In 7-10 years the price of memory and compute should drop by 80-90%. In ten years the bleeding edge 14,000 token/s machines and 4TB memory is going to look quaint, "that stuff can't even bootstrap a kernel and entire (usable) posix-compliant OS in less than a week" vs the future of "the computer updates it's firmware in real time to meet the needs of the current task"
>In 7-10 years the price of memory and compute should drop by 80-90%
The mechanism through which this occurs being..?
But why would these same trends not also vastly improve the capabilities of the top hardwares and ability of the trillion-dollar companies to leverage their economies of scale?
I'm all for the idea that AI capabilities can be democratized and help ordinary scientists outside of a handful of labs. But it seems there would need to be some checks against Big Tech and it won't happen by just letting the free market do its thing.