logoalt Hacker News

skybrianyesterday at 7:03 PM4 repliesview on HN

It's common sense now. It hasn't always been common sense that AI alignment is an important problem.


Replies

thrw045yesterday at 7:13 PM

It depends on what you mean by alignment. If you mean the sense it's used now, meaning bias in models, security and safety for users and so on, then that's a way more mundane version of alignment than what Yudkowsky and ilk promoted. They are talking about a superintelligent being possibly destroying humanity / the earth. And it wasn't that hard to predict. We have many examples of more technological / "advanced" people ruling or extinguishing weaker people. So a superintelligent AI being a threat is not a huge leap.

IMO they have been consistently too aggressive on timelines. When GPT-4 came out, Yudkowsky said it might be conscious. I think he has written interesting stuff but let's be real

show 1 reply
Dylan16807yesterday at 7:16 PM

If we do a survey of stories about AI from the last 50 years, it seems like it's a worry everyone knows about, and that people generally take seriously in proportion to how much they think an AI will actually exist.

drdaemanyesterday at 7:17 PM

Why? Science fiction talked about technology’s behavior and human expectations of it even way before computers became mechanical.

Stories about golems going rogue and genies requiring careful wishing aren’t modern era inventions.