alt Hacker NewsAnother CEO with AI psychosis [1]. LLMs are not true AI, they lack common sense (or whatever it's properly called). LLM-based systems still need somebody with deep domain knowledge at the wheel to keep them from doing stupid things. It's like an alien-made bicycle that gets you to the speed of sound if you are an Olympic cyclist.
Still, LLMs are extremely powerful pseudo-AI [2] and will bring a pseudo-singularity. But the impact is still scary if a tiny fraction of humans are augmented 1000x. And as better models become exponentially more costly, only the money people will be able to afford the new models. This is a very likely scenario and scares me to the point I dropped all my projects to work on affordable LLM-based tools to make the difference at most 10x instead of 1000x.
To my elder relatives I explain it like: imagine we are farmers in the 17th century and suddenly out of nowere John Deere tractors, combines, etc. become available. But they cost more to run than all you and your fellow farmers have, so only a tiny handful of rich people take over everything.
Replies
> ... they cost more to run than all you and your fellow farmers have ...
But the financial situation is that running a single AI agent costs significantly less than you'd have to pay a human to do the same task.
And I don't see what you're getting from The Chinese Room - that thought experiment relies on there being no external difference at all, right?
> Another CEO with AI psychosis [1]. LLMs are not true AI, they lack common sense (or whatever it's properly called).
If you read the article, you'll find that the it indeed relies on this claim:
> Within a couple of years, possibly much sooner, AI may achieve so-called closed-loop recursive self-improvement (RSI): the capacity to rewrite its own code to become more capable, without human intervention. Should that happen, the result could be an intelligence explosion of a kind for which there is no precedent and no map.
This may be optimistic and/or simplistic, but not impossible.