logoalt Hacker News

aesthesia • today at 6:34 PM • 1 reply • view on HN

But why would you train on this capability versus, say, optimizing RL training runs?


Replies

haickernews • today at 6:40 PM

1. It's more direct

2. Could lead to interpretability gains

3. Might generalize

Probably more reasons I haven't thought of. I am not an expert, so take this as layman's opinion.

Edit: Catastrophic forgetting might also be able to be mitigated.