On some level though we have to be cognizant of the potential for harm these models have.
LLMs are still a little loosey goosey, and we are right on the cusp (if not there already) for an agent to hack a bank and steal money for some rando teenager with a penchant for jail breaking.
The regulations are and will be negative, but don't lose sight of what LLMs can do off the leash.
Bank should be more secure, if a random person with an LLM can hack them, they should have paid 100 random blue teamers with LLMs to hack them first to get more secure. Not AI's fault.
>but don't lose sight of what LLMs can do off the leash.
there is no such thing as an LLM "off the leash", it's not a dog, and even if it was a dog the person responsible is the owner. What is this bizarre attitude to a piece of software that makes people think existing laws don't apply?
If your LLM agent hacks a bank, you have hacked a bank, you will go to prison and that's entirely sufficient. People have been hacking banks for decades now, it didn't require the government to regulate C compilers and Emacs.
> On some level
The appropriate level would be regulation though? Like I just don't get how we can argue that arbitrarily throttling companies is ok.