logoalt Hacker News

frabcus • today at 12:03 PM • 1 reply • view on HN

BTW, just to be clear it is insane that they're all still pursuing it, so completely reasonable to be sceptical and come up with other reasons. This is, however, a crazy situation. Lots of other people have refused to develop it - natural selection has picked those with a galaxy brained or vain strategy involving continuing to develop it to be running the companies we have.


Replies

meowface • today at 4:24 PM

Their mindset is: the upside is likely so, so, so immense, and the probability of amazing outcomes is so much higher than the probability of catastrophic outcomes, that the gamble is worth it, and it is not in fact a pure gamble because they can (in theory) try really hard to build it really slowly and carefully.

So even with their earnest belief that there is a > 5% chance this technology could be 1) capable of autonomously killing billions of people during this century and 2) may not be sufficiently aligned and might actually act on that capability, the EV basically still sums positive, to them.

Not saying this is necessarily a good or moral calculus. But it is what they think. There is no conspiracy or plot or deception.