logoalt Hacker News

dmixyesterday at 9:59 PM1 replyview on HN

Yes that's been obvious since the beginning. That's why you should always monitor your agents closely. Just like supervised self driving cars, you have to watch the road and do some hand holding.

The tooling around isolation, logging, and real time security/anonomly detection for regular LLM laptop users is very immature right now. I expect that to change soon.

The alternative is extremely locked down models which is what Anthropic seems to want to do.


Replies

xmprttoday at 12:17 AM

> Yes that's been obvious since the beginning

But if it's so obvious, then why are we still relying on it in the system prompt. It's just wasting context at this point.