logoalt Hacker News

SPascareli13yesterday at 11:13 PM2 repliesview on HN

Like how crypto used ASICS but then didn't because the scaling of consumer hardware made it obsolete?


Replies

wtallisyesterday at 11:41 PM

To the extent that cryptocurrency moved off ASICs, it was because of interest shifting to different cryptocurrencies that were specifically designed to be harder to mine on an ASIC than Bitcoin's compute-heavy, memory-light hashing.

I'm not sure there's any reason to expect a similar shift from LLMs. The hardware used for training doesn't dictate what hardware needs to be used for inference, and nobody's going to design an LLM architecture with an overt intention to make it better suited to GPUs and hard to target with ASICs.

show 1 reply
actionfromafaryesterday at 11:40 PM

Am I missing some joke here?