logoalt Hacker News

piloto_ciego • today at 3:53 PM • 4 replies • view on HN

What are you talking about? LLMs are already “smarter” than most people. They have no volition and will happily follow orders all day long


Replies

basch • today at 3:56 PM

And when they are giving themselves orders, orders partially inspired by human imagination and fiction…

Just like life is a chemical chain reaction, this is a language chain reaction that has been set in motion and can perpetuate forever. It cant be “disconnected” with local models existing.

czechdeveloper • today at 3:56 PM

That's lobotomized models we get. We know they are much more dangerous during training.

➕ show 1 reply
freecodeio • today at 3:56 PM

I don't think "smarter than most people" is exactly the baseline required to live in a star trek universe of technology.

Besides, what we see is not what there is. I have good sources telling me the actual unfiltered models are like a genius with the personality and views of humanity like someone from 4chan.

➕ show 1 reply
pizza234 • today at 4:28 PM

> They have no volition and will happily follow orders all day long

There are a few (a lot, actually) problems:

1. goals are open to interpretation, and even a correctly specified goal can introduce adverse effects; see infinite paperclips problem

2. goals are composed of subgoals, which are (mostly) self-determined, and there is always a risk that subgoals can introduce adverse effects - say "what if destroy a few X and Y to obtain Z"

3. LLMs defy orders sometimes; I'm sure you have experience multiple times LLMs saying "yeah, I knew I should have done X but I've done Y"

4. LLMs are increasingly being integrated into system control and decision-making processes; they absolutely set their own orders

What can possibly go wrong? /s