How much does a dedicated server with 128GB vram cost a month.
You can get an H200 (141GB) here for $2,700/mo: https://deploybase.ai/articles/h200-price
I could be wrong but my understanding is that 24/7 dedicated servers are wildly economically unviable. The reason cloud tends to cost less than local today (other than the subsidization) is because you aren't running models 24/7. So like 6 hours of cloud per weekday might beat the yearly cost of building local machines, but it's not in the same universe if you're running 24/7, as evidenced by two months of H200 rental costing more than the DGX Spark this Laptop is built out of.
Less than this laptop.
How well will the local LLM run when your laptop is in your bag while you're walking around?