logoalt Hacker News

IAmGraydon • today at 5:32 PM • 1 reply • view on HN

Mining ASICs are bound to a single cryptographic hashing algorithm, meaning they do one thing and they do it very fast. Something similar may make sense for running models locally, but I believe the more multifaceted Nvidia chips make more sense for training.


Replies

ChainOfFools • today at 5:43 PM

Taalas takes a similar approach but at a much higher level of complexity - instead of an array of nnn tiny specialized cryptographic cores running the same algo (or a mix of several with interlocking dependencies), it freezes a single entire LLM on to one die, running inference both far faster and cooler than any general purpose compute but with the same one trick pony obsolescence drawback. Question remains whether high volume fab tech can be wrangled into a form that allows this approach to drop unit costs near "disposable/recyclable" levels of cheapness per chip. This also may not matter when models all start to converge on a 'good enough' level of coverage for specific domains that the chips can remain productive for 3-4 years before needing a recycle.