logoalt Hacker News

aftbittoday at 6:21 PM1 replyview on HN

I tried to query a lot of resources (NFT images, many of which are/were hosted on IPFS) from IPFS myself using the official Go server, running on some pretty fast/wide hardware, for a good part of 2021 and 2022. It was a dumpster fire. Here are two specific problems that I remember, though I ran into several more. First, the UDP storm that it created somehow broke my network, where all of my switches gave up and just started sending all of its traffic to all of the nodes on the network. That could have been a "me" thing but it really made it hard to trust. I ended up having to give that server its own VLAN. Second, the caching was brain dead. By default, it would write every resource to the cache even if I was just using it to download them to a local directory, so it wrote everything twice. Even worse, when the cache was full, it would just drop the whole cache, which created huge spikes in IO util. I ended up patching the app to remove caching.

It felt like a really cool demo that never got cleaned up to work as a real production product.


Replies

Animatstoday at 6:34 PM

Ouch.

Remember Filecoin? The original concept was that you could buy perpetual storage with a one time payment. It was funded by a crypto asset which was a derivative of mass storage prices, or something like that. Lighthouse supposedly sold such a product.[1] They no longer do.[2]

[1] https://www.lighthouse.storage/blogs/Permanent%20Storage%20P...

[2] https://www.lighthouse.storage/pricing

show 1 reply