alt Hacker NewsLuckily very few people can configure and are interested in local models. But your nearby datacenter running Chinese open-weight models is also good enough.
Luckily very few people can configure and are interested in local models. But your nearby datacenter running Chinese open-weight models is also good enough.
My point is that dram demand is mostly orthogonal to whether everyone is using open weight models or secret weight models. Heavy demand for local models (whether secret or open weight) will require even more aggregate DRAM than for shared.
Demand will only go down if people reduce their use of these AI tools. Given how much folks here complain about quotas, I'm very skeptical that will happen willingly.