logoalt Hacker News

ygjb • today at 3:45 PM • 0 replies • view on HN

The ship has sailed. For personal use, maybe, but supply and demand are going to dictate that there is going to be a massive ramp in memory and compute production, and when the prices inevitably normalize due to the increase of availability, there will be a push to use local inference. It goes back and forth, and unless there is a strong roadblock put in place, the current generation of models are already powerful enough that incremental improvements in the run up to increased hardware availability will mean that these tools are here to stay. Even if draconian laws were put into place, the prevalence and availability of open models and the tools to train them means you can't put the genie back in the bottle.