logoalt Hacker News

MarceliusKlast Tuesday at 6:33 AM1 replyview on HN

How much global infrastructure has improved… but also how physical logistics can still beat the internet when you're dealing with massive datasets.


Replies

dkhlast Tuesday at 9:17 AM

The technical requirements always seem to increase at the same rate as the technical advances. I've found this especially true in film/TV. Sure, by 2014ish we were shooting on solid state and had giant RAIDs on set and storage was cheaper than it ever had been, but we easily negated all of that by shooting on multiple RED cameras in raw at resolutions of 6.5k+. Terabytes of new data each day, even duplicating it before leaving took a lot of time! And then storing it at the office while letting more than 1 editor work with it at the time meant building a 36-disk ZFS server with 10GbE to each client. Just playing the footage back on a computer required a dedicated PCIe card