logoalt Hacker News

gerdesjyesterday at 10:25 PM1 replyview on HN

I (we) run Qwen3.8-27B-FP8 on a DGX Spark box - that's roughly £4000 of hardware.

I did benchmark it in various ways and it runs quite well but it is a quantised jobbie and 1.5k t/s is also rather faster than anything I can possibly hope to achieve.

To run that model at those sorts of speeds is going to need some serious investment and you are going to have to pay for it.


Replies

jacquesmtoday at 12:50 AM

How fast is it?