logoalt Hacker News

Do not buy RAM, compress

191 points • by Ecno92 • today at 8:56 AM • 161 comments • view on HN

Comments

varenc • today at 4:13 PM

As others have said, macOS does this by default and it's quite impressive. I have a long running daemon with a memory leak. By its nature, the leaking memory is very repetitive and easily compressed. Right now this daemon has tried to claim 2.5GB of memory, but it's been compressed to a mere 450MB of actual memory! And because it's a memory leak, it never accesses this old stuff, so it never gets decompressed. Only 20MB of RAM is held that isn't compressed.

Of course, it would be far better to just not have the memory leak...but in the mean time, macOS memory compression is making the leak nearly a none issue.

➕ show 4 replies
Lio • today at 10:54 AM

RAM compression sounds very useful but the thing I really need extra RAM for is local inference.

Since the models are effectively highly compressed data already my assumption is that RAM compression won't help improve that much (I'm assuming unified memory here as per the Framework Desktop). A bit like trying to compress a JPEG in a zip file.

Could anyone comment on that?

➕ show 6 replies
jakozaur • today at 11:16 AM

> Memory compression is not new. If you have a Windows or Mac device you are already using it.

Yes, macOS has had it enabled by default since OS X Mavericks 10.9, released in October 2013. I’m surprised some desktop Linux distributions still require manual configuration to enable it.

For browser tabs, though, I think a better solution is automatic tab closing, using something like the Tab Wrangler extension for Chrome. Collecting tabs comes naturally; we’re much worse at closing them.

➕ show 5 replies
hedgehog • today at 4:44 PM

As others have noted zswap is usually a better choice than zram, additionally depending on your situation it may be worth checking which algorithm it's using as there are a few choices (zstd, lz4, etc) and the defaults vary by distro. zstd is the right choice IMO unless you're in a situation where you know better.

flowerlad • today at 5:48 PM

In the 1990s there was a third-party add-on for Windows called SoftRAM95 [1] that doubled your RAM using compression. That one turned out to be a scam though [2].

[1] https://en.wikipedia.org/wiki/SoftRAM

[2] https://devblogs.microsoft.com/oldnewthing/20211111-00/?p=10...

cogman10 • today at 3:25 PM

Don't use Zram, use Zswap. Especially if you want to swap to disk.

https://chrisdown.name/2026/03/24/zswap-vs-zram-when-to-use-...

➕ show 3 replies
jmakov • today at 7:14 PM

Looking at the solution AMD bought, looks like Linux has a lot of room to improve regarding moving (compressed) inactive pages to disk: https://www.amd.com/en/products/software/mext.html.

If my understanding is correct, both ZRAM and ZSWAP write uncompressed pages to disk. And both don't pack the pages together meaning even if we'd write compressed pages (let's say they compress 5:1), we'd still write the original size to disk. This is crazy.

➕ show 2 replies
noodlesUK • today at 7:52 PM

I think it's a great shame that kubernetes really doesn't like systems with any kind of swap on (including zswap). If memory compression were more commonly used I think many workloads could survive on smaller systems.

zamalek • today at 7:56 PM

> Compressing memory does come with small, but not really noticeable, downsides. It takes a little bit more from your CPU and adds latency to some processes.

I recall reading an article around the time the Windows team added it (back when I still used the OS). Their compression algorithm was typically faster than the latency to the prevailing disk type at the time (SATA SSD, most likely) - at the time it had zero downsides. I'm not sure if that still holds true.

On Linux it generally doesn't: off-the-shelf compression is used, which do not outpace storage access latency.

sammatilda • today at 10:39 AM

I just discovered zram thanks to claude after installing fedora on a new computer and man I was blown away by both zram and fedora. Fedora amongst the linux distributions for some reasons has really got everything that an end user needs and the whole experience is just way smoother than anything I have used in 25 years on linux.

I am hoping to switch my dad from ubuntu to fedora in a month or so because he has 16 GB ram and this seems like something most people dont know.

➕ show 5 replies
Juvination • today at 3:36 PM

What a fun loop through time. I remember downloading programs to free up ram in the early 2000's, then as RAM became more ubiqutous and programs were still small you could run them directly on RAMDisk. (I did this with Path of Exile about 10 years ago to avoid lag.) Now we are working back to getting the most out of our ram.

2001zhaozhao • today at 8:16 PM

I do this and also buy old used 16GB Optane sticks to use as swap. These are $7 a pop on ebay. They're way lower latency than normal swap and you can swap data as much as you like without worrying about wear.

bullish-bearr • today at 8:25 PM

Doesn't this only work if you have a bunch of stuff you do not need to access frequently in RAM? i wonder what kind of algorithm optimization goes behind the scenes to make sure pages that least recently used get compressed with other pages

myrandomcomment • today at 3:56 PM

MacOS does this by default for inactive pages. On my current system with 18GB of RAM I show 4.80GB for Apps, 3.16GB Wired and 5.06GB Compressed.

certyfreak • today at 11:21 AM

I switched to Fedora some time ago and only recently learned about zram. I was hitting full system memory(16GB) during normal use, and after increasing my zram to 16GB, I was blown away. I had initially planned to buy additional ram.

nukanse • today at 12:06 PM

For a programmer, on many cases, it pays to compress the data, to improve RAM IO, because the alu may already be doing nothing meanwhile waiting for the data from ram, so you can use that time to decompress, process, compress, and store the result. A lot of code today is bottlenecked by IO. You spend a lot of effort optimizing with SIMD, processing the data super fast, and then the speed it's wssted because there is not enough bandwidth to even send the result to ram. Modern cpu should include more hardware support for memory compression

Lerc • today at 3:33 PM

I have to wonder if the better solution would be for browsers (and apps that are effectively broswers) to compress their data proactively.

I find that the ratio of browserish memory use to that of other programs is enough to render the latter insignificant most of the time.

➕ show 1 reply
roosgit • today at 9:23 AM

MacOS has been doing this for quite a while now. I was a bit surprised this wasn’t the default for most Linux distros, although I think Pop!_OS (what a name!) has had zram enabled for a few years already. I turned it on on one of my servers (1GB RAM) and it works fine.

➕ show 2 replies
aktenlage • today at 12:34 PM

So, if it is used as swap, that means to use the data, it first needs to go to the CPU, then back to regular RAM, then back to the CPU.

Isn't that wasteful? The CPU's caches may help a bit, but I would guess first a huge block is going through the decompression, so only the last bits are still in the cache, when the actual usage starts.

altcognito • today at 4:25 PM

It's funny that MS didn't integrate memory compression until 2015. From ye olden days, we used "RAM doublers" in MSDOS, which were a bit of a different beast and took a performance hit due to simpler implementation, so some of us aren't "excited" by the cost of packing things in with compression. It is a bandaid for processes that lie somewhere between being needed and not (otherwise it would goto swap right?)

If it avoids hitting the disk I get it, but to some of us, that just means it's time to buy more RAM

rustyhancock • today at 11:34 AM

I've used zswap on most of my systems and generally find it beneficial especially as (de)compression can be very fast these days.

What's interesting to note is that I've occasionally wondered why isn't the swap partition compressed.

If you have it on an NVMe drive it probably is as is all data! The controller usually transparently does it as it writes to/from NAND.

So the kernel sees uncompressed fixed block pages and the speed boosts happen with data arriving faster when read or written to flash.

➕ show 2 replies
pyaamb • today at 4:19 PM

I wonder what the theoretical limits are of semantic compression for LLM input/output (eg. "Can you please send me the final report by Friday?" -> "Send final report by Friday." -> sr(FINAL, DEADLINE=FRIDAY)) that can still be recovered back to English

➕ show 1 reply
grandlimelabs • today at 5:38 PM

Make sure to stress-test compression and decompression for whatever you're doing before you go jumping into relying on it, though.

IronWolve • today at 4:40 PM

I remember the compression rage back on my amiga, had both ram and file compression, since you had to get as much room as you could with limited ram and a floppy.

1970-01-01 • today at 5:36 PM

This feels like the kind of thing that leads to 0day. Compression can defeat security. Delta frames. Compression bombs.

https://www.youtube.com/watch?v=4icQwducz68

https://www.youtube.com/watch?v=IXkX2ojrKZQ

bismanawaz • today at 5:28 PM

I was wondering if its the agents itself or the browsers that they open fill up the RAM?

72deluxe • today at 1:11 PM

Having viewed that page, I cannot fathom how Firefox is using 27GB of RAM in his screenshot?!

➕ show 2 replies
djha-skin • today at 8:33 PM

This guy already had 32GB RAM. I know that's "standard" or whatever but it's surprisingly difficult to afford when you already have an 8GB laptop at home that still works on Linux. Would be interesting to see someone trick out a low-powered 4GB one, I would find that very interesting.

ChrisRR • today at 10:49 AM

> Compressing memory does not come with downsides. It takes a little bit more from your CPU and adds latency to some processes

It sounds like those are downsides

➕ show 7 replies
vjvjvjvjghv • today at 7:32 PM

Looks like I need to find my old SoftRAM floppy disk. Maybe somebody can come up with something that saves memory that's not used much to disk?

kiicia • today at 11:17 AM

nice try Ram Altman

distantsounds • today at 3:47 PM

Hilarious ending to the article. You expect some implementation details with a Getting Started section, instead you get a "check the arch wiki" link.

➕ show 1 reply
yummybear • today at 10:57 AM

"Compressing memory does not come with downsides. It takes a little bit more from your CPU and adds latency to some processes"

Which one is it?

tonymet • today at 7:57 PM

I was load testing micro VMs with zswap and i was blown away by how much capacity the machine could have. forking thousands of processes, using 2.5x the available ram, and the server still hums along, albeit a bit sluggish. but no timeouts or lockups. still very accessible.

It's a remarkable tech that deserves more attention. Swap is back in style!

Ecno92 • today at 8:56 AM

Since I am using Claude with parallel sessions in different workspaces I started to run out of RAM.

Instead of buying more RAM, which meant that I should replace my device, I decided to implement zram. This compresses memory. Now I can do more with the same hardware.

In many cloud environments compression is not enabled. I am curious to see if the same gains can be made in such environment.

➕ show 1 reply
baud9600 • today at 11:49 AM

You’d hope with these amazing GPUs today, that some cycles can be used to compress RAM very efficiently. So many parallel cores, surely we can get even better compression from this latent hardware?

➕ show 1 reply
tooheavy • today at 3:43 PM

Compression is fine as long as the CPU doesn't become the bottleneck.

1023bytes • today at 4:10 PM

Do not buy RAM, download more RAM

fernandogrd • today at 3:25 PM

Things I did: - Zswap instead of zram. - Unload browser tabs (my own private extension. - Force idle cli AI agents to go to disk swap earlier.

LoganDark • today at 11:54 AM

Windows doesn't do memory compression if the page file is not enabled. I never particularly saw the point of the page file because I don't enjoy swapping, but it appears that the memory management system disproportionately depends on it to the point where it simply refuses to work properly with it off. So make sure that's turned on if you want memory compression. (Do not let it auto-size or it will happily fill up your whole drive, set it to something reasonable)

➕ show 1 reply
fred_is_fred • today at 3:28 PM

What's old is new again! https://apple.fandom.com/wiki/RAM_Doubler

➕ show 1 reply
pshirshov • today at 3:41 PM

Vectors do not compress.

UltraSane • today at 5:07 PM

IBM Power systems have hardware RAM compression.

cubefox • today at 11:59 AM

So why is zswap (basically zram+swap) not enabled by default everywhere?

➕ show 2 replies
dist-epoch • today at 11:30 AM

> If you have a Windows or Mac device you are already using it

Technically yes, practically on Windows memory compression is not used.

I have Windows 11, 128 GB RAM, and my memory stats show: 42 GB in use, 380 MB compressed.

➕ show 1 reply
jauntywundrkind • today at 11:20 AM

In many systems, adding compression makes not just storage better but increases the io you get from a system too. Here's Valkey 9.2 compression figures showing that: https://www.phoronix.com/news/Valkey-9.2

That's for RDB persistence. https://valkey.io/topics/persistence/

I wonder if there's any similar wins with ram? That some workloads would see net wins from compression. Some cost of cpu, but increasing net throughput significantly.

hinkley • today at 12:09 PM

Okay, Johnny Mnemonic.

varispeed • today at 5:13 PM

Do not eat, drink water.

As usual, working class is being told to tighten the belts whilst the rich get insanely richer.

Fuck that.

➕ show 1 reply
DeathArrow • today at 11:12 AM

I have built my PC with core i7 14700K, RTX 3090,128 GB DDR3, 2TB SSD, 8TB HDD about 3 years ago.

Still perfectly usable and I won't upgrade until prices come down. Even used prices are terrible now.

➕ show 2 replies

🔗 View 4 more comments