alt Hacker NewsRise of local models? what rise? I run qwen3.8 flash next on my 200GB/s 128gb Strix Halo and even that is barely acceptable, big models require so much more. Nobody's running a local model on their power sipping phone. It's just a nerd's wet dream.
Rise of local models? what rise? I run qwen3.8 flash next on my 200GB/s 128gb Strix Halo and even that is barely acceptable, big models require so much more. Nobody's running a local model on their power sipping phone. It's just a nerd's wet dream.
That's true today, but what will it look like in 20 years? Over time, algorithms and hardware always gets faster and more efficient. Like if I wanted to run a fluid dynamics simulation, what would have required a supercomputer 20 years ago can now run on a single desktop computer.