logoalt Hacker News

clbrmbrtoday at 11:21 AM0 repliesview on HN

Are you thinking of fundamental architectural changes (like the Transformer)? Or incremental (like MoE or GQA)? Are there specific neolabs or techs you are following that lead you to this prediction?

Indeed it seems quite possible we are one architecture breakthrough away from existing chip stock driving us all the way to ASI.

Nobody has done AFAIK the information theory to prove it’s not possible.