logoalt Hacker News

luxpir • today at 8:57 PM • 0 replies • view on HN

Was pleasantly surprised to get 25-35tps on 3060, 12GB VRAM with Bonsai2. Quite smart, tool calls, vision, 95+% intelligence of dense qwen3.8 27b apparently.

Impressed with your setup @lrvick. Hoping Bonsai type improvements bring local inference to more modest setups. Still use frontier models for now, but very ready to stop.