logoalt Hacker News

teamonkey • yesterday at 11:52 PM • 4 replies • view on HN

Why is the login information even allowed to touch the context?


Replies

michaelt • today at 12:23 AM

For the user's name it's intentional; they template it into the system prompt with no option to disable it.

For 99% of users, the model knows it's in the /home/joesmith/whatever repo and `git log` shows the last change was by `[email protected]` - trying to keep the user's identity secret from the model would be nigh-impossible so I think anthropic gave up on even trying.

➕ show 4 replies
zbentley • yesterday at 11:58 PM

I can think of tons of common prompts and tasks for which the AI being easily able to introspect subscriber details would be very useful.

Wish that were itself behind a permission wall, but I guess everyone just uses auto mode anyway so perhaps that ship has sailed.

➕ show 2 replies
oefrha • today at 12:21 AM

Do you use git? I have bad news for you, your email will be all over the place in the context as long as the agent is allowed to read git log, whether it’s injected into the system prompt or not. (Likely retort: but not that email! Sure, but leak potential is obviously still there.)

➕ show 1 reply
cowlevel • today at 3:33 AM

So that if you tell it to do something with your email address it'll know what that is.