Yeah agreed, especially for legal and healthcare models.

[edit] I'd go one step further too and say the training data should be explicitly requestable too so third parties can verify (freedom of information act styles).