logoalt Hacker News

bananaflag • yesterday at 9:09 PM • 1 reply • view on HN

Yeah, Zvi calls it "the forbidden technique"


Replies

afthonos • yesterday at 11:50 PM

Not quite; training against the chain-of-thought is the Most Forbidden Technique, because it might teach models to obfuscate the it. The point of avoiding that, though, is to ensure the chain-of-thought can be usefully read (and, done carefully, monitored).