alt Hacker NewsAn ill advised undertaking IMO: Any attempt to build AI generated content detection systems is flawed, since the outputs of such a system may be used to train an even better fake data generator. This leads to an equilibrium state of digital uncertainty: nothing in the digital realm can be deemed as real anymore - only as digital.
Replies
I doubt AI labs have beating Pangram as an optimization goal.
there's some truth to what one says but after hearing how Pangram works I'm pretty impressed at the methodology
I think the founder once said something like "well you can try to fight our detection and do a bunch of stuff, you just might find yourself with a pile of extremely garbled text that is less than useless".
How is that a downside exactly? If we can’t tell then we are no worse off.
> the outputs of such a system may be used to train an even better fake data generator.
[citation needed] - my understanding of how entropy works in real photos vs. synthetic images (AI or not) is that this is extremely difficult without severe degradation of image quality.
[dead]
AI detectors can't work in theory, but Pangram works well in practice. This is because the AI companies are not trying to fool Pangram. They have no incentive to; in fact the incentive goes the opposite way. They want to watermark their outputs to leave no doubt as to whether something was generated by their AI.