alt Hacker NewsA lot of Vast.ai GPUs are also firmware-limited, so it's a big gamble when you run your workloads. You also can't get a cluster.
It's fine for comfyui workloads or simple LLM inference, but you lose both privacy and stability.
Replies
guppy • today at 6:03 PM
each machine's power limit and performance are displayed and filterable on vast. not sure about other marketplaces but vast is pretty transparent about the measured specs of their machines
➕ show 1 reply
GPUs set to lower power states and CPUs with frequency scaling turned down. That's the biggest hit and miss for what I'm doing. Honestly don't care if people are looking at my workloads as it's just processing public data. But do care if it's someone's laptop that's actively using 1/2 the vram.