Maybe detecting watermarked text is a skill to be attained. Not allowing proper feedback and training will not allow people to notice the difference on time, thus ruining the data?

Best practice is to allow a number (scaled based on complexity of task) of training rounds (with short feedback loops) prior to letting people loose on the regular samples.

Detecting watermarked text is hard. Detecting AI garbage text is easy but then classfiying the garbage further is beyond us.

> I believe this is to test the theory that people can detect watermarked text.

> Teaching you how to identify watermarked text while the experiment is running would ruin the data.

But that's complete nonsense. If it's possible to teach someone how to identify watermarked text, then you've already proven that people can detect watermarked text.