logoalt Hacker News

apitoday at 12:11 PM2 repliesview on HN

They're pretty basic and hallucinate a lot. There are some hard limits to how good you can get on a model that fits on a phone.

Qwen3 and Gemma level models that run on mid-high end laptops and desktops can be pretty good. Not frontier grade, but shockingly competent for something that runs on a single PC. But the hardware you need to run those fast is at least $1000-$2000. Cheap hardware can run them, but slooooooow.


Replies

ourcattoday at 1:38 PM

And then you've got the local "Wan2GP" setups "for the GPU-Poor".

Also tried the "Locally Uncensored" setup on a 3060 laptop, which worked surprisingly well.

imhoguytoday at 12:48 PM

You can still lease GPU farm in many "easy" countries.