logoalt Hacker News

stupefylast Thursday at 9:34 PM1 replyview on HN

What limits LLM inference accelerators? I heard about Groq (https://groq.com/) not sure how much it pushes away the problem.


Replies

vesseneslast Thursday at 9:38 PM

ASML only makes a certain number of machines a year that can do extreme ultra-violet lithography.

Also - turbine blades limit power, according to Elon.

Between them - we cannot chip fabs past a certain rate, and we cannot stand up the datacenter to run these desired chips past a certain rate. Different people believe one or the other is the 'true' current bottleneck. The turbine supply chain scaling looks much more tractable -- EUV is essentially the most complicated production process humans have ever devised.

show 5 replies