logoalt Hacker News

sampullmantoday at 8:46 PM2 repliesview on HN

This is difficult to read, maybe just link to a gist?


Replies

woadwarrior01today at 8:49 PM

That's because it's copy pasted from a coding agent.

show 2 replies
Argonautlabstoday at 9:04 PM

Thank you! Here is the short version:

  Kimi K3, 2.78T parameters, ~1.45 TB of MXFP4 experts streamed from four SSDs on an M5 Max / 128 GB. 1.00 tok/s steady over 512 tokens, 1.13 over 128, ~6.3 min to first token on a 512-token prompt. Output token-identical drafter on/off on a given drive layout; the int8 trunk is non-weight-exact per upstream.
  
  The useful bits: one drive gives ≈52% of four, two ≈73%, three ≈90%; and prefill is slow because of ~9 TB of reads for a 1.4 TB model — a scheduling bug with a planned fix.
  
  README with per-run logs: github.com/argonautlabsai/deltafin — a fork of gavamedia/deltafin, who built the engine.