logoalt Hacker News

afthonos • yesterday at 11:50 PM • 0 replies • view on HN

Not quite; training against the chain-of-thought is the Most Forbidden Technique, because it might teach models to obfuscate the it. The point of avoiding that, though, is to ensure the chain-of-thought can be usefully read (and, done carefully, monitored).