logoalt Hacker News

amlibtoday at 6:22 PM1 replyview on HN

Isn't specialized hardware also a big risk? GPUs are more amenable to any big changes that may happen in the next 5, 10 years of AI research. Maybe we won't even be talking about LLMs anymore. Maybe matrix multiplication won't even be the main primitive.


Replies

moduspoltoday at 6:41 PM

If matrix multiplication isn't the main primitive, I think we have a lot of pain coming our way.

show 1 reply