A 800B model that performs way worse than other 300B ones. Well...
Why buy one 256 GB Studio, when you could buy two 512 GB's for lower-quality output?
Local LLM's really sharpen your senses to model size. You could fit a car in the price difference!
What are you using to determine performance?
alt Hacker News
Why buy one 256 GB Studio, when you could buy two 512 GB's for lower-quality output?
Local LLM's really sharpen your senses to model size. You could fit a car in the price difference!