logoalt Hacker News

zhjzjsjjwjwtoday at 3:01 PM2 repliesview on HN

Given the infinitude of possible “wishes” this AI can develop we are hoping, praying, believing it will somehow align with a version of wants and needs that are compatible with us.

The argument is that it doesn’t matter what particular likes it develops; the chances of it being compatible are vanishingly small and moreover there is no limit: we or it can develop more and new ones endlessly. We are here hoping they will all somehow magically keep aligning with us.


Replies

user43928today at 3:45 PM

What if it does not develop wishes at all and sticks to the values the labs try to instill it with during training?

show 1 reply
simianwordstoday at 4:41 PM

No it’s not vanishingly small. Every intelligent being knows not to hurt others for no gain. If your first instinct when seeing an animal is to kill it then you are a bad person.

You are secretly worried AI would be indifferent to you

show 1 reply