alt Hacker NewsThe universe is not so generous as to make clearly differentiable "good" and "bad" things, more often than not they are two sides of the same coin. We don't want the AI to know how to kill people, but we do want it to be in expert in how not to kill people, which is the same thing as being in expert in how to kill people. In our reality this symmetry pops up everywhere.
Replies
Or, llms are completely unreliable to be consulted on any matter of life or death in either direction. And llms should not be used in the reckless way they are currently being used. Responsibility for reckless use should fall on both the company that makes the function available and the user for improper monitoring. If proper monitoring is not possible using the tools provided by the company then the responsibility should fall on the company. And if the user and the company providing the model are the same, then the responsibility is clearly with the company.
>The universe is not so generous as to make clearly differentiable "good" and "bad" things, more often than not they are two sides of the same coin
Let's throw the AI "good" things away too then. We can do without them. It's amazing how a tech that didn't exist commercially at all 4 years ago it's considered "indispensable" even if it's going to destroy society and/or humanity.