alt Hacker NewsI think there is a wide spectrum between small-homelab and google scale.
I was surprised how far sqlite goes with some sharding on modern SSDs for those in-between scale services/saas
I think there is a wide spectrum between small-homelab and google scale.
I was surprised how far sqlite goes with some sharding on modern SSDs for those in-between scale services/saas
What you're doing is fine for a homelab, or learning. But barring any very specific reason other than just not liking Kafka, its bad. The second that pattern needs to be fanned out to support even 50+ producers/consumers, the overhead and complexity needed to manage already-solved problems becomes a very bad design choice.
Kafka already solves this problem and gives me message durability, near infinite scale out, sharding, delivery guarantees, etc out of the box. I do not care to develop, reshard databases or production-alize this myself.