logoalt Hacker News

toomuchtodo • today at 5:07 PM • 1 reply • view on HN

What format would you prefer the dataset in for consumption? A series of archives shared as magnet link torrents like Reddit? Open to suggestions.

https://github.com/ArthurHeitmann/arctic_shift/blob/master/d...

https://academictorrents.com/

https://github.com/ArchiveTeam/grab-site

"You can just do things."


Replies

Jordan-117 • today at 5:15 PM

I wasn't a regular there beyond from occasional search hits. But presumably heavy users would want their contributions preserved in a way that's still useful for the type of people they wrote them for in the first place. An archive.org or torrent copy means they still technically exist, but not in a way that's helpful in a practical way.

It'd be like if Wikipedia suddenly closed down tomorrow -- prolific editors would take cold comfort from being told their contributions are still available to anybody who downloads an obscure multi-gigabyte archive file.

➕ show 1 reply