logoalt Hacker News

embedding-shapetoday at 11:10 AM5 repliesview on HN

> We build on our prior research by using three different AI detectors (Pangram, GPTZero, Copyleaks). We independently evaluate each to show that the false positive rates and average false negative rates are consistently below 2%. Each AI detector shows a similar trend.

This is all bullshit, none of those actually work, and the false-positives rates are sky-high. I'm not sure how any serious person have tried out any of those services and came away with the impression of "Well, better than nothing" because literally, it seems the opposite.


Replies

dgellowtoday at 11:24 AM

The detectors aren’t great but they aren’t really the issue. The fact that LLMs make it so easy to impersonate human communication is precisely the problem here. There cannot be a reliable way to identify if something is from a human or not. And the ease of access and low price makes using LLM generated content a no brainer, you have to actively go out of your way to produce human generated content.

We are building a future where human contact will be scarce

show 1 reply
lelandfetoday at 11:18 AM

So if these do not work, to what do you attribute the rising positive rate?

show 1 reply
My_Nametoday at 11:28 AM

If you need an AI detector to figure out if something is AI or not, surely that means the AI is so good that there is no need to detect whether it is AI or not, because it is indistinguishable from writings by a human when read by humans?

navstoday at 11:47 AM

I mean this is an article coming from an SEO company that's really just trying to advertise its services in the end. Their methodology seems very loose.

tidewinnertoday at 11:18 AM

Are you an AI agent trying to gaslight us?

show 1 reply