logoalt Hacker News

8organicbits • today at 5:05 PM • 2 replies • view on HN

How did I miss zstd?

Here are my benchmarks for 2.3 GB of jsonl, on a laptop. Compressed size, compress time, decompress time; using defaults.

    gzip  7.3%  21s  9s
    bzip2 4.6% 251s 50s
    bzip3 3.3%  82s 69s
    zstd  6.9%   2s  3s
    lzma  4.7%  51s  3s

Replies

vlovich123 • today at 5:16 PM

At what levels? There’s no guarantee that the default compression level is comparable. You have to normalize by time spent compressing.

out_of_protocol • today at 5:17 PM

zstd with better compression level would be nice - these numbers are not really comparable since both time and compression level are too different