alt Hacker NewsAs I understand it, the restriction of LLMs has nothing to do with getting poor quality/AI reviews. Like you said, you’re not really getting graded on it. Instead, the restriction is in place to limit the possibility of an unpublished paper getting “remembered” by an LLM. You don’t want to have an unpublished work getting added as a fact to a model accidentally (mainly to protect the novelty of the authors work, not the purity of the LLM).
Replies
I don’t think that’s how LLMs work. If that was the case anyone could feed them false info eg for propaganda purposes…
That's nonsense. I can spend the whole day creating false papers on AI, then feeding it back to another AI to check its "quality". Is this making the paper to be "remembered" by AI? If yes, then we have deeper problems and we shouldn't be using AI to do anything related to science.
Huh. That’s an interesting additional risk. I don’t think it is what the original commenter meant, because they were talking about catching cheaters. But it is interesting to think about…
I dunno. There generally isn’t super high security around preprint papers (lots of people just toss their own up on arxiv, after all). But, yeah, it is something that you’ve been asked to look after for somebody, which is quite important to them, so it should probably be taken pretty seriously…
I dunno. The extent to which, and the timelines for, the big proprietary LLMs to feed their prompts back into the training set, are hard to know. So, hard to guess whether this is a serious vector for leaks (and in the absence of evidence it is best to be prudent with this sort of thing and not do it). Actually, I wonder if there’s an opening for a journal to provide a review-helper LLM assistant. That way the journal could mark their LLM content however they want, and everything can be clearly spelled out in the terms and conditions.