> If Anthropic thinks even for a second that they are preventing something really bad from happening... somebody needs to wake up real quick.

IMHO this is like thinking "It's okay for me to do X because if I don't someone else will."

No, if (you think) X is bad / ethically questionable you should not do it even if someone else may. You are responsible for your choices, and if someone else does/allows it then that's on them, not you.