logoalt Hacker News

AI companies are shredding rare books

700 pointsby anon373839today at 12:32 PM444 commentsview on HN

https://xcancel.com/HedgieMarkets/status/2081534588485296565


Comments

Cider9986today at 2:46 PM

It's not like these books were available to everyone before. If they are destroying one physical copy that's not accessible to the public and replacing it with a scanned copy that isn't accessible to the public, that's not a huge change. Except that will probably last longer digitized. Ideally they wouldn't destroy the physical copies, but this isn't anywhere as bad as book burning in Nazi Germany.

I find going after shadow libraries to be much worse because law enforcement is trying to prevent discrimination of knowledge to the public.

The real blame here should be going onto copyright laws.

Anthropic could take more care by figuring out if the books are still affected by copyright.

But this is just a company trying its best in an unfortunate regulatory environment.

Support your local shadow library:

https://annas-archive.pk/donate

storustoday at 2:33 PM

That's one way to pull the ladder if regulatory capture fails...

paxystoday at 1:51 PM

People keep bringing up these rare books but never share what they actually are. What are their names? When were they written? How many copies were in existence? Were they in libraries, or locked up in vaults? Did people have access to them prior to being scanned for AI? How many such books have actually been destroyed?

Weird to see so many of these "trust me bro" twitter stories make it to the front page and cause outrage when no one has any real information.

iamsaitamtoday at 2:20 PM

If you consider that AI companies should pay the same for a book, as a person does, you should read about royalties.

hagen8today at 2:11 PM

Where are the sources for that?

show 1 reply
mindslighttoday at 2:10 PM

The design of copyright has always been to restrict the dissemination of knowledge so that somebody can turn a profit. The handwaved justification is that the profit encourages the creation of new knowledge whose dissemination can be restricted, but that still doesn't erase the fundamental dynamic.

This is merely the latest incarnation. We can imagine a slightly different process on a few fronts - AI companies pay to digitize books (still for their own purposes), but are prevented from destroying the physical copies and they have to openly shared the digitized results. We would view that situation much more favorably - perhaps even as ideal, right?

Those two dynamics could be backed up by court decisions or laws iff they weren't so plainly at odds with how copyright has been and is generally implemented and interpreted. For example, imagine them having to do this through some nonprofit library whose goals was preservation and dissemination. Instead, libraries have been sidelined as things that operate at the edge of the law rather than vital public institutions, whereas shredding books in secret is fully legally condoned.

show 1 reply
tokaitoday at 1:53 PM

I don't buy this at all. Looking up some of the mentioned rare books, in other sources, on worldcat shows every single book available somewhere. Most of them in dozen or even hundreds of libraries.

dandelionesstoday at 1:53 PM

They change the info then destroy the source. Now the lie is in the LLM.

petesergeanttoday at 1:35 PM

So the premise here is that the books are valueless enough that they're being sold by weight, but they're also rare enough that someone will one day wonder where they went, and also that the AI companies aren't also saving the text somewhere much safer than physical media in a warehouse. k.

freejazztoday at 1:33 PM

Why would you need to shred a book from the 1800s when it is in the public domain? Something is fishy here.

bigbuppotoday at 4:06 PM

I can't help but make a comparison to one of those road planning memes.

Just one more book, bro, and we'll solve AGI forever. Trust us, bro, just one more book. Come on, let me have those words and we'll solve AGI forever.

tannerr_devtoday at 2:30 PM

absolutely diabolical

skeledrewtoday at 6:06 PM

Another consequence of the existence of that thing called "copyright".

gowldtoday at 3:09 PM

Everyone who refused to buy these books in the past was voting for the books' destruction by default. Authors don't owe you a copy of their work. Bookstores don't you real estate to hold a book you don't want and will never want.

enaaemtoday at 1:11 PM

This is the destruction of Western civilisation.

ertucetintoday at 3:30 PM

They are playing dirty.

pmkarytoday at 3:05 PM

Horribly horrible horrific horrible insane psychopaths

Good4bootheetoday at 12:58 PM

> A federal judge ruled the practice is fair use because eliminating the original means only one copy exists at a time.

Really? That sure wasn't a thing when one startup got sued for streaming from its wall od dvd-players, and they adhered to 1 disc = maximum 1 stream at same time.

show 1 reply
RIMRtoday at 5:14 PM

I feel outraged, but I also worry this article isn't necessarily responding to what's actually happening.

It's a weird practice to destroy a book when you digitize it, but it's at least an understandable legal strategy to ensure that the digital copy "replaces" the physical one. However, this is only going to apply to books that have active copyrights.

This author suggests that a rare 18th-century botanical text could fall victim to the same fate, but I am somehow doubtful that this is the case. Non-destructive scanning is trivial, and these kinds of books are likely being processed in a quantity that would allow for it without backing up the pipeline.

I really like 404 media, but it doesn't really seem like the evidence points to the conclusion here. Yes, AI companies are shredding books that they digitize, and yes, AI companies are digitizing old, rare books. But the rationale for the book shredding doesn't exist for the old, rare books, so I would need more evidence than just "putting two-and-two together".

At the end of the day, old books with no resale value, including rare books, end up destroyed with some regularity by libraries and bookstores. While this may be an excessively generous take, at least this way the books are getting digitized before they become pulp. The real tragedy will be if the old, rare books that were digitized are never shared with the rest of us, because they were ONLY digitized to train AI, and not to actually preserve anything.

1234letshaveatwtoday at 1:46 PM

you wouldn't believe how much shredding your local library does in the name of space conservation and to address changing borrower preferences and demographics. I doubt any AI company comes close to the annual combined library turnover

show 1 reply
retinarostoday at 1:01 PM

if they do this you can foresee what else they can do

show 1 reply
apitoday at 1:37 PM

People would have at least somewhat less of a problem with this if they also put up an archive of PDFs of all these rare books if they are out of copyright.

But that would help competitors with training data, which I assume is why they don’t do this.

impsunrisetoday at 1:55 PM

ironically, this tweet and account appear to be complete AI slop

qseratoday at 1:25 PM

All those AI powers, and they cannot find a way to do it without destroying the books? Pathetic.

psychoslavetoday at 3:51 PM

Guys never heard of palimpsests and how your regular scans won’t necessarily catch all data there is in the material?

Of course even disregarding this fact, this is utterly disgusting attack on humanity heritage, just as much as any group out there destroying what we should all cherish be it for the historical artifact they represent. Whatever how US judge name it, they don’t worth more than their same-behavior consorts that is terrorists and totalitarian governments.

https://en.wikipedia.org/wiki/Palimpsest

https://organiser.org/2025/07/24/304285/world/china-wages-wa...

https://www.historyexpose.com/things/demolition-afghanistans...

https://link.springer.com/chapter/10.1007/978-3-031-96432-9_...

emsigntoday at 3:17 PM

That's exactly why I have been hoarding physical media for years now. I knew they would be buying them up, besides the usual dumpster fire they would end up in when people throw them away. CDs, DVDs, BluRays, books, vinyl, everything. And as they are physical they are not prone to retro-editing. Just like in 1984.

Luckily I don't live in NYC where book hoarders are being evicted because of "fire hazard". Just like in Fahrenheit 451.

tudou527today at 4:04 PM

[flagged]

SwtCybertoday at 3:32 PM

[dead]

z0ltantoday at 3:09 PM

[dead]

flippedtoday at 1:19 PM

[dead]

fibobraintoday at 1:07 PM

[dead]

bebe8393jrirtoday at 1:23 PM

[flagged]

cluckindantoday at 2:16 PM

This is not that different from having a book burning march. The fervent neocon tech overlords and their funding circles want a monopoly; not only on truth, but on ideas and thought in general.

vessenestoday at 12:54 PM

I don't see any proof of shredding here. Most book scanners I'm aware of are from Google's scanning days, and those had cameras plus page turning.

If we use 'shredding' to mean A book is laid flat, its cover is removed, and then a paper cutter cuts through the binding to create a flat stack of sheets, which are then fed to a sheet feeder, then I could maybe imagine this is better than a page-turning scanner. But, sheet feeding old paper sucks shit, bro. It's not fun.

Upshot, I think we'd like to hear from an anonymous frontier lab employee here to see what's going on -- there are a lot of books in Anna's archive available at considerably less difficulty.

show 1 reply
timcobbtoday at 1:06 PM

This kind of reads like a blood libel. My guess is they're buying all those books that University libraries are throwing away these days (to see other HM threads for that), kinda sad but probably aren't "rare books" in the way people are thinking

iandanforthtoday at 2:09 PM

If true this is basically unforgivable. The wanton destruction of history is the stuff of the Third Reich and the Taliban. You simply cannot profess to care about knowledge, culture, or civilization while destroying the physical manifestations of the same.

show 1 reply
kruncktoday at 2:31 PM

In a society that values science and knowledge, preservation of knowledge - and no, slurping text up into an LLM is not preservation - is more important than profits.

These companies are regressive book burners.

show 3 replies
greenlimeteatoday at 3:10 PM

This is potentially very bad.

Like, Library of Alexandria or Council of Nicaea bad.

We may never be able to recover the information if, say, one of these AI companies copied or translated it wrong then destroyed the source material.

Maybe it's from bad OCR, or maybe from a bad actor - but there are a lot of ways history and information could change in this game-of-telephone like transfer of knowledge.

What is the point of destroying the source material? I don't buy the copyright thing.

show 3 replies
stuartjohnson12today at 12:52 PM

I think people are, on the whole, too precious about old things. In the case of books produced after major commercial printing began, I don't believe it is the paper that imbues the book with historical value.

Indeed, I think there's a high chance that this process increases preservation of the most relevant part of the media - the actual content!

There are tons of old rolls of film slowly rotting away in warehouses that were never digitised. Even for beloved media, the BBC occasionally tracks down an old lost episode of Dr Who.

For now these books are in corpuses of training data, but eventually I trust they will make their way to the rest of us.

show 4 replies