logoalt Hacker News

IshKebabyesterday at 8:28 PM2 repliesview on HN

> It's going to happen very soon

Why? You can't just assert it. There are very good reasons to think it won't happen soon, and you've given no reasons to think it will happen soon.


Replies

blurbleblurbleyesterday at 10:32 PM

Because everything is converging on a backlog of huge efficiency gains established in research, waiting to be combined. Looped transformers, a whole host of diffusion techniques and new quantization techniques, maturation of ternary distillation and new ways to separate logic from stuff that can be looked up. It would surprise me if most frontier models were actually even that big at that point in terms of active params. I highly doubt it.

dwedgeyesterday at 8:48 PM

You asserted that it was never going to happen first

show 1 reply