alt Hacker NewsTheir mention of the 5090 is bit odd, since on 32 GB GPUs, Q6 fits while having better quality. Very interesting model for 16 GB GPUs though!
Replies
sisve • yesterday at 10:17 PM
They mention 5090 with regards to speed, Q6 will not have that speed?
And speed matters a lot for many use cases
➕ show 2 replies
Sometimes you want a decent model running in the background that doesn't take up all the VRAM.