What are you talking about? LLMs are already “smarter” than most people. They have no volition and will happily follow orders all day long
That's lobotomized models we get. We know they are much more dangerous during training.
I don't think "smarter than most people" is exactly the baseline required to live in a star trek universe of technology.
Besides, what we see is not what there is. I have good sources telling me the actual unfiltered models are like a genius with the personality and views of humanity like someone from 4chan.
> They have no volition and will happily follow orders all day long
There are a few (a lot, actually) problems:
1. goals are open to interpretation, and even a correctly specified goal can introduce adverse effects; see infinite paperclips problem
2. goals are composed of subgoals, which are (mostly) self-determined, and there is always a risk that subgoals can introduce adverse effects - say "what if destroy a few X and Y to obtain Z"
3. LLMs defy orders sometimes; I'm sure you have experience multiple times LLMs saying "yeah, I knew I should have done X but I've done Y"
4. LLMs are increasingly being integrated into system control and decision-making processes; they absolutely set their own orders
What can possibly go wrong? /s
And when they are giving themselves orders, orders partially inspired by human imagination and fiction…
Just like life is a chemical chain reaction, this is a language chain reaction that has been set in motion and can perpetuate forever. It cant be “disconnected” with local models existing.