logoalt Hacker News

zoobab • today at 1:29 PM • 1 reply • view on HN

Strata gave local AI a boost with 12GB (and even 8GB) cards being able to run Qwen code assistant with RAM offloading.


Replies

jabron • today at 1:34 PM

The issue with local AI is the availability of competitive open weight models, not necessarily the availability of compute and memory.