logoalt Hacker News

jacquesm • today at 2:53 PM • 0 replies • view on HN

That rig is running single GPU most of the time and like that it is good for 95% of what I'm doing. If I need to evaluate a large model or if the smaller ones get stuck on a problem (which does happen) then I run GLM 5.3 3.86 bpw on all of the GPUs. It's a nice space heater in that configuration, so I see it as co-generation ;)