alt Hacker NewsPeople aren't good at detecting AI generated/edited comments, so unsure how effective this policy will be. Though I guess there are still some obvious signs of AI speak like emdashes and sycophantic (it's not X, it's Y!) speech.
Bit of a shameless plug but I wrote a HN AI comment detector game[0] with AI and most of my friends and fellow HN users who tried it out couldn't detect them.
Replies
> HN AI comment detector game
Looks cool, but how exactly do you gather proven-to-be human comments?
I think it would be better if you used pre-ChatGPT (Nov 30 2022, I think?) stories.
I appreciate the restraint in not calling your game "AIdle".
> obvious signs of AI speak like emdashes
Some of us were trained/self taught to write that way. Even "it's not X, it's Y" is a legitimate and subjectively effective communication tool, and there are those of us who either by training modeling have picked it up as a habit. It's not Ai that started this, Ai learned it from us.
Crap - I just did it, didn't I? Awww double crap! Did it again...
Something I've noticed through moderation is that people are much more easily duped by generated comments if they like the content and/or agree with the point. We've seen several cases where a bot-generated comment has been heavily upvoted and sits at the top of the thread for hours, and any comments calling it out for being generated languish at the bottom of the subthread below other enthusiastic, heavily upvoted replies. This shouldn't be surprising, given what we've seen of LLM chatbots being tuned to be sycophantic, but it's interesting to see it in effect on HN.
This is another reason why it's good to email us ([email protected]) rather than commenting when you see generated comments.