logoalt Hacker News

datsci_est_2015 • today at 6:29 PM • 2 replies • view on HN

“Sorry officer, I didn’t intend to shoot her, I was just firing my gun wildly and she got in the way.”

I don’t know why I’m seeing this rationalization so much in this forum when this topic comes up. Negligence is a concept in law as well. You don’t have to squint to see that irresponsible use of code-generating language models is criminally negligent.


Replies

ofjcihen • today at 7:06 PM

When you think about it it’s not surprising that any sort of engineer has trouble with mens rea.

➕ show 1 reply
gruez • today at 6:33 PM

>Negligence is a concept in law as well. You don’t have to squint to see that irresponsible use of code-generating language models is criminally negligent.

That's a poor analogy for the openai case, because they weren't putting agents on the open internet, they at least tried to keep it safe by sandboxing the agents. It just turned out the sandbox was crap because the package proxy (artifactory) had a 0day. So the better analogy would be that they were wildly shooting guns in a gun range, and ended up killing some kids, because it turned out the door didn't lock properly and kids were able to sneak in. Is that "negligence"?

➕ show 5 replies