logoalt Hacker News

p-e-wtoday at 3:47 PM1 replyview on HN

It’s true that architectures change, but they are built from common components. The most important of those is matrix multiplication, using a relatively small set of floating point data types. A device that accelerates those operations is, effectively, an ASIC for LLMs.


Replies

bfrogtoday at 3:49 PM

We used to call these things DSPs

show 1 reply