alt Hacker NewsI agree, the fundamental problem is we wouldn't be able to understand it ("AGI"). Therefore it's useless. Either useless or you let it go unleashed and it's useful. Either way you still don't understand it/can't predict it/it's dangerous/untrustworthy. But a constrained useful thing is great, but it fundamentally has to be constrained otherwise it doesn't make sense
The way I see it, we build technology to be what we are not and do what we can’t do or things we can do but better or faster.
An unpredictable fallible machine is useless to us because we have 7+ billion carbon based ones already.