In case people want to run it, it's DeepSeek-V4-Flash-284B-A13B. So it should just barely run on a single B300, and it's small enough that it'll barely run on an M5 Max too.
Not yet, right? That's the old DS V4 preview release. We're still waiting for the weights to come out.
"it'll barely run on an M5 Max "
The max version I could order now with 128 GB?
If so, the price for local inference would be 12 000 € vs 500 000 € for a B300.
It runs really well on 2 DGX Sparks - 60t/s