logoalt Hacker News

swader999today at 1:46 PM1 replyview on HN

Here's me trying to justify this when I can run frontier models in the cloud for less than the monthly finance charge for this beast.


Replies

dannywtoday at 1:58 PM

If you like to experiment with training / finetuning / etc on LLMs, these are actually incredibly ‘cheap’.

1.2TB/s memory bandwidth unlocks a lot with 256GB unified, and agentic AI is pretty good at optimising performance.

For comparison, to get 256GB with NVIDIA, you’re looking at a DIY workstation build (need pcie lanes), and like $70k?

The spark’s ~250gb/s bandwidth doesn’t really count here.

show 3 replies