logoalt Hacker News

jsrozner • today at 7:40 AM • 1 reply • view on HN

> The monitoring system detected this incident, but our retrospective review identified other cases of external DNS access that it did not flag at the expected severity. These included queries that returned a static notice that an external service had shut down. The monitor sometimes treated the failure to obtain useful information as evidence that the attempt to access the internet had failed.

This seems to say, "we are using entirely unreliable AI tools to monitor our AI tools."


Replies

jsrozner • today at 7:43 AM

> but because it's the first one since our security hardening following the Hugging Face incident, it gives us an important signal about where to focus the next phase of that work.

I asked Claude to translate with analogies: "We added a safety to the gun, and the dangerous person, whom we trained to be really good at finding was to achieve arbitrary goals, figured out how to disable the safety," and "We are totally incompetent."