logoalt Hacker News

matheusmoreira • today at 12:00 AM • 1 reply • view on HN

I never claimed the LLMs themselves couldn't "accidentally" leak the information through. Obviously, the LLMs can do anything they want.

The issue here is whether the harness is doing it. Claude Code is doing it. Codex is not.


Replies

oefrha • today at 12:13 AM

The problem here literally is the non-deterministic model cooking up commands with the user email address in the header, and the harness not blocking that (and the implemented fix is to deterministically block that), not the harness deterministically hardcoding the email in the web search tool. No technical report I’ve seen has claimed the latter, although this particular linked report which is low quality and vague can be misinterpreted as that.

➕ show 1 reply