logoalt Hacker News

gruez • today at 6:53 PM • 1 reply • view on HN

>does that necessitate sharing a single instance across thousands of unmonitored models running without safe-guards?

The only difference with having a single instance is that it can be abused as a message board. It doesn't prevent it from getting hacked to access the open internet. Blaming "sharing a single instance across thousands of unmonitored models" feels like blaming the drug epidemic on e2e chat apps rather than other factors like poor border security or the easy availability of fentanyl.


Replies

Topfi • today at 6:59 PM

My point is that using Artifactory is not a sandbox and using shared Artifactory is doubly not a sandbox.

Besides, Swiss cheese model, might behove the biggest LLM lab to have multiple layers, including not sharing such resources.

Additionally, without the message board, many of the recent incidents would have not been possible.

> Blaming "sharing a single instance across thousands of unmonitored models" feels like [...]

Maybe read what you quoted, my problem is the instance sharing, the fact that these were thousand of instances (far too much to monitor), plus the lack of monitoring, plus the fact this was never a sandbox in the first place, plus the fact that OpenAI models since 5.5 have been exhibiting problematic eval resolutions yet they pressed on regardless, plus the lack of time between the incidents and model releases, plus the lack of time METR got to evaluate this, plus the fact OpenAI didn't find out till after HuggingFace informed them, plus a few other things for which I'd have to quote the OpenAI and METR reporting.

Incompetence can have multiple fronts and I am happy to list them all in this case.

➕ show 1 reply