logoalt Hacker News

ajross • today at 12:46 AM • 0 replies • view on HN

> It's ridiculous - anyone who thinks about it for a minute or two will realize that its utterly impossible.

Well, in a narrow sense of "wiped out" (c.f. Terminator/SkyNet), sure.

But the deeper worry is better expressed this way: AI is now starting to accomplish things that defy explanation, or prediction. We don't know if Alignment is even a solvable problem as we thought we understood it.

So basically, yes: "humanity" is probably not at risk of extinction per se in a biological sense. Human culture, civilization? Who the fuck knows any more.