Strata gave local AI a boost with 12GB (and even 8GB) cards being able to run Qwen code assistant with RAM offloading.
The issue with local AI is the availability of competitive open weight models, not necessarily the availability of compute and memory.
The issue with local AI is the availability of competitive open weight models, not necessarily the availability of compute and memory.