logoalt Hacker News

cmrdporcupinetoday at 3:42 PM1 replyview on HN

Two (linked) DGX Sparks would do it I guess. Though probably slowly (I'd guess 15-20 tok/sec for decode, but higher for prefill). So ~$8-9k USD at current RAM prices, substantially less if they ever (sigh) drop. Electricity use would actually be relatively modest.

But it makes little to no sense as long as API prices are what they are. Except for maybe privacy reasons.


Replies

ycui7today at 4:17 PM

the rational in one’s mind is similar to buying expensive supercar but no driving it daily.

owning a few GPUs is a lot cheaper than supercars.

show 1 reply