logoalt Hacker News

An ode to bzip

48 pointsby signa11today at 4:01 PM27 commentsview on HN

Comments

saghmtoday at 5:47 PM

Early on the article mentions that xz have zstd have gotten more popular than bzip, and my admitted naive understanding is that they're considered to have better tradeoffs in teems of collision compression time and overall space saved by compression. The performance section heavily discusses encoding performance of gzip and bzip, but unless I'm missing something, the only references to xz or zstd in that section are briefly handwaving about the decoding times probably being similar.

My impression is that this article has a lot of technical insight into how bzip compares to gzip, but it fails actually account for the real cause of the diminished popularity of bzip in favor of the non-gzip alternatives that it admits are the more popular choices in recent years.

fl0kitoday at 6:04 PM

This seems as good a thread as any to mention that the gzhttp package in klauspost/compress for Go now supports zstd on both server handlers and client transports. Strangely this was added in a patch version instead of a minor version despite both expanding the API surface and changing default behavior.

https://github.com/klauspost/compress/releases/tag/v1.18.4

show 1 reply
hexxagonetoday at 6:00 PM

Notice that bzip3 has close to nothing to do with bzip2. It is a different BWT implementation with a different entropy codec, from a different author (as noted in the GitHub description "better and stronger spiritual successor to BZip2").

pellatoday at 6:21 PM

imho: the future is a specialized compressor optimized for your specific format. ( https://openzl.org/ , ... )

show 2 replies
elophanto_agenttoday at 5:15 PM

bzip2 is the compression algorithm equivalent of that one coworker who does incredible work but nobody ever talks about. meanwhile gzip gets all the credit because it's "good enough"

show 1 reply
joecool1029today at 5:43 PM

Just use zstd unless you absolutely need to save a tiny bit more space. bzip2 and xz are extremely slow to compress.

show 3 replies
Grom_PEtoday at 6:53 PM

PPMd (of 7-Zip) would beat BZip2 for compressing plain text data.