I've got a Framework with 128GB. Sure, I'm probably not going to run Deepseek V4 flash (though, I could run the 2-bit quant). But there are a lot of models (especially MOE models) that run fine. Even Qwen3.5-122B in a 4 or 5 bit quant can run. The Qwen3-coder-next (~80B IIRC) runs fine (IIRC I'm running a 6-bit quant of that one). The much vaunted Qwen3.6-27B is runnable, but kind of slow (~20t/s with MTP), though that's not a memory limitation issue.
Yeah, It's be great to have 256GB RAM, but that's really expensive now anyway and there's no way I could get my wife to sign off on spending 5 grand (or more now) on a box with that much memory.