Start with 4, see my other comment. The recent GLM, Qwen and DeepSeek releases are amazingly promising.
>Start with 4
Sure, let me just buy $60,000 worth of GPUs to run a *quantized non-frontier model*.
For that price you could:
- put a down payment on a home in a large % of the US
- buy a brand new car in cash (possibly two!)
- take a long sabbatical and travel the world
- pay all 4 years or your child's college tuition
Now, if I could afford 4...
>Start with 4
Sure, let me just buy $60,000 worth of GPUs to run a *quantized non-frontier model*.
For that price you could:
- put a down payment on a home in a large % of the US
- buy a brand new car in cash (possibly two!)
- take a long sabbatical and travel the world
- pay all 4 years or your child's college tuition