logoalt Hacker News

LoganDark • today at 7:35 AM • 1 reply • view on HN

You don't necessarily need a reviewer that's immune to prompt injection. Maybe one that can express a panic state with conflicting/ambiguous material rather than going along with it could also work, and you can treat that with a shutoff to be safe, or an operator review.

Such a model doesn't yet exist though, of course.


Replies

saagarjha • today at 8:07 AM

No, you really do. Otherwise you can be prompt injected into complacency.

➕ show 1 reply