logoalt Hacker News

atomashevic • yesterday at 10:26 PM • 1 reply • view on HN

Just curious, what TT hardware do you have? How many tps did you achieve with Qwen 3.8 27B?


Replies

jaykru • yesterday at 10:51 PM

I'm running 2x p150a's right now. I have them hooked up to a mini-ITX PC with a single PCIe slot via a quad x1 switch (figuring out power to wire up the other two cards I own). My best numbers so far are around 2500t/s prefill about 52t/s decode with DFlash2. All of this is vibecoded besides the original design sketch which was maybe a 3 line description of what tweaks to make to tinygrad and which parts of the existing TT stack to use (almost nothing).