alt Hacker NewsSorry! The problem is ~2kb of data per 1.5M headwords. We already use indicies and brotli compression internally. I doubt we could smush below 3GB.
Replies
neuroelectron • 06/03/2025
Wow only 3gb? Finally i have something to use the 128gb this iThing came with besides Firefox and Kindle.
Could you... have fewer headwords? That's like 5x the number of headwords actually used in modern English. Or at least download some of the data on demand?