logoalt Hacker News

maxsperoyesterday at 6:46 PM3 repliesview on HN

Yeah, Pangram does not provide any concrete proof, but it confirms many people's suspicions about their reviews. But it does flag reviews for a human to take a closer look and see if the review is flawed, low-effort, or contains major hallucinations.


Replies

vladmsyesterday at 7:06 PM

Was there an analysis of flawed, low-effort reviews in similar conferences before generative AI models?

From what I remember, (long before generative AI) you would still occasionally get very crappy reviews (as author). When I participated (couple of times) to review committees, when there was a high variance between reviews the crappy reviews were rather easy to spot and eliminate.

Now it's not bad to detect crappy (or AI) reviews, but I wonder if it would change much the end result compared to other potential interventions.

show 1 reply
jmpeaxyesterday at 8:12 PM

> does not provide any concrete proof, but it confirms many people's suspicions

Without proof there is no confirmation.