alt Hacker NewsI don't think this is true. There are people who claim everything is AI – maybe even to bolster their ego.
But for a lot of things I can with high probability discern between AI and human in every day appearance and I know many other people can as well. One of the things I look for is specifically certain types of extreme... not just flaws... just overall atrocity. When I read posts submitted to HN I often realize that something is bad writing before I can specify this to AI text. Pangram almost always agrees with me. Here is a recent example: https://news.ycombinator.com/item?id=49715657
I don't doubt that there are certain scoped tasks that certain models are quite good at. But in my every day life I constantly encounter AI slop that is so bad that I take it as a personal insult that someone thought it would be okay to subject me to it; to presume that I am so tasteless and numb and have no quality standard whatsoever.
I mean just look at the example posters at the beginning of the article. "The problem with these is not so much that they’re bad." Yes, yes it is. They are horrible. I cannot understand how anyone can describe them as anything but that.
Replies
> One of the things I look for is specifically certain types of extreme... not just flaws... just overall atrocity.
So, please forgive me, but this means that you are good at finding out some patterns in AI output. There are always a lot of false positive and negatives, and I haven’t found a convincing study showing that people are good at finding AI in general.
What helps is that the market is very concentrated so if you know GPT-isms and Claude-isms that’s basically the current situation covered. It does not mean that you can reliably identify AI in general.
They are pretty shit, but the main problem is that they are the generic style of the model. So that’s what everyone gets by default. If they were a one off they’d still be bad, but at least unique.
How do you know you can discern AI vs human with high probability? You need some external source of truth to judge that, otherwise all you know is that you can discern bad, obvious AI. See also https://en.wiktionary.org/wiki/toupee_fallacy
> But for a lot of things I can with high probability discern between AI and human in every day appearance and I know many other people can as well.
It’s easy to say that when you already know the answer. But my point is people frequently misattribute stuff as being AI generated when it wasn’t. The GPs Twitter example is proof of this. And you only have to look at the number of times people accuse someone of being AI on HN because they happen to use em dash or an Oxford comma (or any other writing style that was part of the corpus models were trained on), and it’s pretty clear that “obvious tells” are just guesswork.
There was a study years ago where a group of individuals were given white wine with red food colouring, and they were asked to describe the wine. All the participants described plumb and other notes that are exclusive to red wines.
These weren’t dumb people. And the people who claim to spot “obvious AI” aren’t dumb either. It’s just very easy to identify tells if you believe you already know the answer. Unfortunately that’s just how fucked up our human psychology is.