logoalt Hacker News

glimshetoday at 3:44 AM2 repliesview on HN

The very first paragraph is fascinating: "Several AI companies are acquiring large quantities of secondhand books through intermediaries, scanning and destroying them, all to obtain training data “untouched by machines” from before 2022."

Is the corpus of human knowledge useful for high quality AI training now essentially frozen in time? Also, how useful old books really are for AI training besides helping AI acquire knowledge about history?


Replies

npntoday at 5:35 AM

No but with 100% clean data you can easily train a model to filter ai generated content.

erutoday at 3:49 AM

> Is the corpus of human knowledge useful for high quality AI training now essentially frozen in time?

No. They also use lots of other methods to get training data.