logoalt Hacker News

SpicyLemonZest • yesterday at 7:26 PM • 1 reply • view on HN

The sensitive data problems aren't just about sandboxing. If a systems development model at Anthropic discovers a clever optimization trick based on a customer's complaints to their account team, that's a great deal that saves a lot of work. If a trading model at Goldman discovers a clever pricing trick based on a customer's complaints to their account team, that's an enormous problem, even if the underlying data is never seen by anyone who Goldman wouldn't trust to handle it responsibly.


Replies

theptip • yesterday at 8:11 PM

Sure, but moving to CMA lets you enumerate the sources and assert the customer complaints are not visible to the workflows that shouldn’t have it.

The “Claude can read everything” model is great for vibe coding but not suitable for regulated industries, which require more structure.

My point is mostly that there is a middle ground that can preserve some of the wins; Claude can vibe up a CMA pipeline pretty quickly. There’s likely room for an internal platform to enforce required invariants though.