logoalt Hacker News

tehjoker • today at 8:32 PM • 0 replies • view on HN

I'm not an AI booster (in a "should" not "can" sense), but in terms of "can" we are going to see next generation hardware (i.e. Vera Rubin GPU architecture) and improvements in model density (i.e. loosely improvements in intelligence per millions of weights), so the models will get bigger, the models will get more dense, and we may see more "expert models" i.e. in the sense that for a while there were human generalists that knew all of science and mathematics until the 1800s, after a certain point we had to specialize since there was too much to know. The models will need to partially specialize after hitting the hardware ceiling.

Bioinspired algorithms may eventually lead to vastly improved intelligence per a weight too.

I don't think we should do this, but I feel doomed in that I suspect that we "can".