Where I draw the line is asking Claude to label training data. I don’t do this.

I ask it questions about large models like big MoEs all the time. I’ve never had it refuse a question, but I would expect it to refuse sometimes.

For training data from existing models I just get open models to spill their guts. It’s fine

In industry we train employees to not reveal proprietary information.

I think it would be easier to do this for a model than a lot of employees