logoalt Hacker News

koe123today at 3:57 AM1 replyview on HN

So, what your saying is that there is a perhaps linear, perhaps exponential increase, and that you are projecting that increase forward indefinitely. Let me know if this is unfair.

Counter argument: does anything else work this way? E.g. Moores law had an end too right? I would argue that the core tech breakthrough (Transformer-based LLM) has been improved, but no fundamental further innovation seems to have been made. The current architecture fundamentally hallucinates, even Fabel even on trivial problems. I.e. as number tokens increase error likelihood goes to infinity. How then, can this scale recursively to infinity?


Replies

lionhearttoday at 4:20 AM

Not indefinitely but at least to the point where they’re smarter than humans.