logoalt Hacker News

dag100yesterday at 6:19 PM1 replyview on HN

Unless reviewing becomes more profitable than publishing, anything that makes both easier will drive one up far more than the other. And it is difficult to conceive of something that would make reviewing much easier without making publishing much easier.


Replies

ianm218yesterday at 8:24 PM

Just as a counterpoint ML and AI research has become much more reproducible over time. I feel like this is relevant because ML / AI researchers are huge power users of AI tools.

Between 2016 and 2021 the share of ML/ robotics/ AI researchers being reproducible (ie contianing code and similar instructions to reproduce) doubled [1].

The major US labs have gone largely closed source (I.e. they no longer publish frontier research) but the Chinese ecosystem has incredibly reproducible code.

This is field dependent obviously but I think it atleast gives reason to be optimistic.

Yes people will churn out fake slop research, but it feels like that can be categorized and then ignored.

[1] https://arxiv.org/pdf/2308.10008

show 1 reply