logoalt Hacker News

swiftcodertoday at 8:34 PM1 replyview on HN

Having worked on a number of message brokers, but not really fucked with append-only log streams, what's the actually selling point here?

Feels like the simplicity wins are made by only solving one half of the problem space (only writes), and it introduces new problems of its own (like how do we truncate the append-only log once readers are done with it?)


Replies

spetztoday at 9:34 PM

There's a core difference between the message queue and the stream, and one of them is that the append-only log acts as a simple database from which multiple independent consumers can read records at the same time; hence, you don't truncate the append-only log unless specified in its settings via a particular cleanup policy (e.g. based on message expiry or its allowed size).