logoalt Hacker News

lrvick • today at 7:42 PM • 1 reply • view on HN

On a 16gb card check out Bonsai2. I run it on my 6800XT.


Replies

luxpir • today at 8:57 PM

Was pleasantly surprised to get 25-35tps on 3060, 12GB VRAM with Bonsai2. Quite smart, tool calls, vision, 95+% intelligence of dense qwen3.8 27b apparently.

Impressed with your setup @lrvick. Hoping Bonsai type improvements bring local inference to more modest setups. Still use frontier models for now, but very ready to stop.