Sounds like they are doing something similar to gain of function research. How can we make LLMs more harmful and then study their behavior?
It's security research. You should want to know about all avenues of exploit regardless of intent. It's the only way to know risk.
It's security research. You should want to know about all avenues of exploit regardless of intent. It's the only way to know risk.