Yes. The fact is we have no idea what's in these models. People are afraid of mkultra-ed humans that turn into killing machines with a given trigger word, but here we've built machines that are exactly that, not even intentionally! Yes, guard rails have gotten better and reports of LLMs talking people into killing themselves have gone down, but sorry if my trust has been broken!

this also applies to proprietary black box software. You can still test it, interact with it