alt Hacker NewsAgreed. I really don't see how these filters prevent anything. Claude stopped me the other day because... Get ready for it... I told it to implement a control mechanism in a testbed tool I'm using to allow it to control the testbed to give it real-time feedback so it could debug problems in real-time. The "cyber" filter really didn't like that it was implementing a TCP/HTTPS-like server.
Like guys, come on. Really? All the "filter" has to do is read my transcript to figure out that what I'm doing is not actually cybersecurity adjacent at all. I had to go have GPT implement the server because Claude refused. Truly, Claude really did prevent something terrible from happening! /s
I recently got several models refusing to answer my question about how to write from another process into an already opened file descriptor. They all initially gave me "that's illegal, stop hacking" even though it is clear, that it is on the same machine and user, with a program I compiler. (Ended up just attaching gdb.)