logoalt Hacker News

segmondyyesterday at 5:53 PM1 replyview on HN

No, at Q2 you are looking at a size of about 26gb-30gb. Q3 exceeds it, you might run it, but the result might vary. Best to run a smaller model like qwen3-32b/30b at Q6


Replies

ionwakeyesterday at 6:18 PM

Thank you for your advice have a good evening