logoalt Hacker News

KPGv2yesterday at 11:45 PM1 replyview on HN

> Or is there a way to archive sites like this?

A couple days ago, someone published their archive of HN that works in any browser.

Archiving sites is easy anyway. I wrote a Scrapy app that archives everything within the a specific fandom on Ao3. TH hardest part is remembering how beautiful soup queries work.


Replies

roywigginsyesterday at 11:52 PM

Static sites are straightforward, yeah. Highly dynamic websites like this one commonly explode when you archive them naively.

show 2 replies