What local model do you recommend these days? I’ve got a 4090, mostly sitting idle.
qwen 3.5 with 9b is being a pretty decent workhorse for me, even with context around 4k.
alt Hacker News
qwen 3.5 with 9b is being a pretty decent workhorse for me, even with context around 4k.