1. It's more direct
2. Could lead to interpretability gains
3. Might generalize
Probably more reasons I haven't thought of. I am not an expert, so take this as layman's opinion.
Edit: Catastrophic forgetting might also be able to be mitigated.