alt Hacker NewsSo, not LLM models, right?
Also on this:
> The numbers are staggering: The DOE's light and neutron source facilities now produce tens of petabytes of data annually
Come on, petabytes are not staggering for entreprise software.
Replies
ben_w • today at 6:37 PM
I'm not sure exactly which enterprises you have in mind, but sure: quantities which can be expressed as "a year's worth fits on my desk" should not be described as "staggering", and 10 PB of hard drives will (just about) fit on my desk.
The LHC, on the other hand, that generates a petabyte a second and has to throw most of it away for obvious reasons:
https://www.itnews.com.au/news/computing-for-the-large-hadro...
I used to work with images representing scans of brain tissue - for a full brain visualization at one horizontal slice terabytes was a common measure and the resolution of those images wasn't even particularly detailed - all the full resolution stuff was taken of tiny sub-sections of interest. This was also two decades ago - so I'm sure they've upped their game.