logoalt Hacker News

hunterpayne • yesterday at 9:24 PM • 2 replies • view on HN

Because the exact opposite will happen. The idea that allowing AI reviewers will increase accuracy is probably foolhardy. People being people will get lazy and review less by hand if at all. And the LLMs will miss plenty of things. Then those papers will get into the training sets for the next LLMs. I think you can see where this goes overtime.


Replies

hodgehog11 • yesterday at 9:58 PM

The issue is generally not accuracy in my experience (humans are even lazier about this). The issue is that LLMs do not understand what is interesting and what is procedural.

augment_me • today at 12:22 AM

What's the incentive or practical way to stop this? There is no incentive from anyone.

Journals get less money from less submissions, conferences get less money from less submissions, manual reviewing takes more time which decreases the time you can spend generating papers yourself, less submissions means less acceptance means less funding grants.

The only possible thing is some idealistic demogogue take that knowledge will get diluted, it will be bad for humanity, etc, which moves the needle exactly 0 in a capitalist society with our incentives.