logoalt Hacker News

walrus01today at 4:51 AM1 replyview on HN

This is a concern but given its size, it's also going to cost a potential user $500-600k in hardware to self host and run Kimi K3 at any useful speed with full context size. It's not something that just anyone interested in attacking a system can use.

The size/cost of hardware is far beyond even something like a self-hosted GLM5.2 Q8 at approx. 850GB GGUF file on disk size, which can run at a slow tok/s rate on a server with 1536GB RAM.


Replies

Xalutionotoday at 7:28 AM

Why would you caculate 500k?

if Kimi is around 1-3tb big, even current DDR5 prices are at 15k.

show 1 reply