alt Hacker NewsThe substantial price is one reason I'm disappointed that open models are still getting bigger and bigger, rather than more efficient in any way.
I just also think that plenty of people buy clusters of Mac Studios anyway.
The substantial price is one reason I'm disappointed that open models are still getting bigger and bigger, rather than more efficient in any way.
I just also think that plenty of people buy clusters of Mac Studios anyway.
Haven't smallish (16-32 GB VRAM) open-weights models been getting better and more capable over the last few years? Seems like what you can run on 'a laptop' today beats the pants off of whatever you could run on that same laptop two years ago.