logoalt Hacker News

liuliu • today at 6:19 PM • 2 replies • view on HN

Where your price is from? https://docs.z.ai/guides/overview/pricing Input tokens: $1.4 Output tokens: $4.4 Cached input: $0.26

The ROI on this hardware from my back-of-envelope calculation is (50M per day for output tokens, 500M (assuming 10x ratio, which again is conservative (probably 4x more realistically)) per day for input tokens, and assuming 90% / 10% mixing (10% output, and 90% input), you are doing $22 + $630 per day), that is less than a year to make the money (2 DGX Stations, $200k) back.

EDIT: actually read the article, it is kinda poorly written with no clear separation what's the performance for decode v.s. prefill, making us arguing about this much less meaningful.


Replies

Doohickey-d • today at 7:33 PM

And it's even cheaper on third party providers. For example the cheapest fp8 on openrouter is $0.5586 input, $0.1037 cached input, $1.756 output. And obviously less on fp4.