logoalt Hacker News

vardalab • today at 5:58 PM • 0 replies • view on HN

Because M3 Pro is not a real thing as far as actual agentic workflows go. I run dual R9700 boxes those idle at 150W Because of a Ryzen AM5, and I run Spark boxes, which are decent But still idle at 45-50 watts a pop. My favorite, to be honest, is a 5090 with a Qwen 27B because that one is good for quick hitters and flies, But again, the box itself idles at 140 watts. So it's really the idle power that I don't like And it's too much of an inconvenience to power boxes down and power them back on, so they just end up running and sucking electricity. I am working on getting some sort of a smarter proxy setup where I would give boxes time to wake up and go to the cloud while they're waking up. So the whole point of having these things running in the background is that you do want them to be almost always available. So power consumption is definitely an issue.