logoalt Hacker News

jnwatsonyesterday at 11:19 PM1 replyview on HN

LLM writing is like AI-generated photos in that you don't notice the good instances of LLM writing, i.e. you don't know your false negative rate.


Replies

lucumotoday at 10:22 AM

I would say that you also don't know the false positive rate. The only person who truly knows is the one who wrote/generated the text. And they have every incentive to say it's not AI-generated, whether or not it truly is.

Personally, when I see the number of accusations thrown around, I very much suspect that the false positive rate is pretty high.