alt Hacker NewsHow do you prune out the 'fails to prune out behaviors' behavior? If my model is failing to prune it out, can another model prune out that behavior?
How do you prune out the 'fails to prune out behaviors' behavior? If my model is failing to prune it out, can another model prune out that behavior?
With normal training you're simply training for higher loss for things you don't want while keeping the loss low for things you do. Same would apply here except you would target low eval for behavior you do not want the model to have rather than trying to increase eval.