alt Hacker NewsI was immediately hoping for some local-AI setups that do real work, on limited resources. Unfortunately it looks like this is still waiting on more people to share.
I was immediately hoping for some local-AI setups that do real work, on limited resources. Unfortunately it looks like this is still waiting on more people to share.
Not a SWE, but I do Freetoken (backend) + unsloth (front) to run qwen 3.6 35B A3B NVFP4 (~20GB) in 8GB VRAM + ~20GB RAM. Getting around 50 t/s on a 3070. I don't think I can even share through this site.