logoalt Hacker News

akerstentoday at 8:07 PM1 replyview on HN

> generated text being watermarked is universally good.

If it worked perfectly, maybe you could make this argument in a vacuum.

It does not work perfectly. (It cannot. It is by definition a heuristic). That means there will be false positives. There is a chance those false positives ruin someone's career. See [0] for just how easy it is to push SotA "AI text detectors" in one direction or another.

Now, with watermarks, instead of everyone to some extent understanding that AI text detectors are wishy washy woo, they are now Anthropic certified to detect an official AI watermark.

With that kind of false confidence in hand, the people who trust the "computer says you plagiarized" machine are never going to believe you when you say "it can make mistakes," they're just going to fire you/take away your scholarship/cancel your grant/...

This is all beside the fact that we should demand our tools work for us and not for some shadowy master. "Universally good," absolutely not.

[0]: https://freddiedeboer.substack.com/p/i-wouldnt-say-pangram-i...


Replies

demibabstoday at 8:19 PM

Watermarking the outputs themselves is very different and much more effective compared to how tools like Pangram work.

Obviously false positives will inevitably happen (even though, they are incredibly unlikely with SynthID), but even still, that doesn’t somehow make good faith watermarking attempts bad.

Also, a watermark doesn’t stop your tool from working for you. It just stops you from passing of its work as yours.

show 2 replies