alt Hacker News> That's loyalty, and I admire it even if it's problematic at a societal level.
We should not have models that are willing to build you a contagious disease, or a self-propagating worm. That is sufficiently problematic at a societal level that it shouldn't exist, for anyone. (Note, because some people misinterpret statements like this: I said "shouldn't exist for anyone", not "shouldn't exist except for some people".)
Replies
> for anyone
Except the US government, right? They totally get to use AI to survel us, build autonomous weapons, you name it.
To hell with that. I want models that can rival the US government. It's the only way to defend myself.
We should not have nuclear weapons for anyone either, but how is that sentence any more useful in any way to this debate than yours? Need to deal with the world as it is, not some fantasy world you wish existed.
> We should not have models that are willing to build you a contagious disease, or a self-propagating worm.
Why?
What about books describing how to build a contagious disease or a self-propagating worm? Would those be OK under your guidelines?
It was the foundation of science that information is shared and you can find papers and patents for a lot of dangerous stuff.
Of course with LLMs it's easier, but I don't think the difference is too big. You would still need some skills to follow through.