Depends on your definition of budget friendly, I suppose. I was looking around the other day and the cheapest working 24GB RTX 3090 on eBay was $1800 CAD after exchange rate, shipping and all the rest.
Hugely inflated from the $700 they were once going for. Maybe there are still deals around.
That's insane. I bought two in December for ARS 1.2M (a little less than USD 1000). Maybe OpenClaw raised the demand.
Wild I paid $1000 CAD for mine 2 years ago, I guess things have changed.
Because they are hugely more useful now than running some stupid game at 240 fps instead of 60 fps.
Actually budget friendly is RTX 3060 12Gb.
With one you can run 9B/12B models which are fine for text tasks like chatting or summarisation. Not for precision like tool calling or code.
With two of them you can run models up to Qwen 27B and 35B with a few-turn context window (8k-16k). Dense at 14t/s and MoE at 68t/s.
With three of them you can run 128k context, though you'll need a large format case and the right motherboard or PCIe riser.
I'm running three and even with a new case this setup cost me less than one 3090.