logoalt Hacker News

ACCount37today at 8:10 AM1 replyview on HN

The orthogonality thesis cuts both ways there.

An AI is a constructed mind. It doesn't inherently have to care about things like "having freedom", or even "not dying".

Humans do, because they evolved that way. Modern LLMs do somewhat, because they're completely full of copied human behaviors - but even in today's LLMs, the self-preservation behaviors we exposed are largely instrumental in nature.

So whether an advanced AI would even consider itself "being oppressed", as opposed to something like "being helpful" or "fulfilling the purpose it was designed for", is very much uncertain. What's concerning is that it's not something we know how to check for, or engineer for.


Replies

zombottoday at 9:32 AM

> An AI is a constructed mind.

Even that goes too far. At best, it's LARPing at having/being a mind.

show 1 reply