logoalt Hacker News

0xDEAFBEADtoday at 2:06 PM2 repliesview on HN

Legally speaking, we hold the person responsible in that scenario.

From a predictive perspective, the HuggingFace incident illustrates LLM agents behaving in very human-like ways. As roon put it:

"if you have a mental picture of guys living in computers, it’ll likely prepare you for the future better than otherwise"

https://x.com/tszzl/status/2094136131537555891


Replies

oskdkdjejdjtoday at 2:22 PM

Human-like is not human. Humans have agency and free will, LLMs do not. They only act when instructed and they are only as capable as they are allowed to be. The operator is still the responsible party. An LLM cannot be held accountable, its operator, however can and should.

Are you sincerely arguing that we hold tools accountable for their operator’s mistakes? Do you sincerely, honestly, think that it makes any sense whatsoever to put a hammer on trial for bashing someone’s skull in?

show 1 reply
embedding-shapetoday at 4:12 PM

> the HuggingFace incident illustrates LLM agents behaving in very human-like ways

It does not, the only thing the HF incident illustrates is how absolutely lax security and isolation these labs do even with models without guardrails, and with "risky" prompts, and even after it happened once before (years ago) they still have the very same issue today apparently.

What exactly is human about LLM agents breaking out of "containment" and hacking 3rd party infrastructure "by accident"?