There’s other slop projects to run of Qwen, like ds4, would be interesting to see a comparison
V4.0 Flash(-vision) in released form is "only" ~180GB of FP4 weights, so a braindead quant could work in 128GB of RAM.
4.1 is much larger, even leaving out the PLE.
alt Hacker News
V4.0 Flash(-vision) in released form is "only" ~180GB of FP4 weights, so a braindead quant could work in 128GB of RAM.
4.1 is much larger, even leaving out the PLE.