logoalt Hacker News

Saving another 100TB of RAM

104 pointsby f311atoday at 6:51 PM20 commentsview on HN

Comments

ricardobeattoday at 8:52 PM

These optimizations are impressive, but it gets me thinking: at what point does a company become a collection of impenetrable siloes, where nothing really does what you expect? Maybe know with AI this is less of an issue as exploring a codebase is also much faster.

show 2 replies
proc0today at 8:49 PM

The only Rust section is the one on storage improvements about the struct that stores the hash, but do they really need that many hashes that 2 bytes makes that big of a difference? Article doesn't expand, but I guess it's a hash for every task on every computer, so maybe yes.

show 1 reply
agostatoday at 8:48 PM

Bang up article! As someone who doesn't get to do enough (almost any) calculus in my daily programming assignments, I thoroughly enjoyed reading about Kevin's dive into that derivation (linked in the supplemental article). All the people being negative here can swallow raisins

show 1 reply
jamesforestwesttoday at 9:33 PM

[dead]

johnnyApplePRNGtoday at 7:37 PM

[flagged]

officialchickentoday at 8:33 PM

Come on CF, you can't even be bothered vibe a README for the crate? Somebody tear down this post until this garbage is documented properly.

I found this in the code, it looks like a rewrite-in-rust:

//! # pingora-ketama

//! A Rust port of the nginx consistent hashing algorithm.

//!

//! This crate provides a consistent hashing algorithm which is identical in

//! behavior to [nginx consistent hashing](https://www.nginx.com/resources/wiki/modules/consistent_hash...).

//!

//! Using a consistent hash strategy like this is useful when one wants to

//! minimize the amount of requests that need to be rehashed to different nodes

//! when a node is added or removed.

show 4 replies
go_elmotoday at 7:42 PM

Was this vibecoded? I hope so, would expect models to be good enough by now, its not that creative.

show 3 replies