logoalt Hacker News

ChainOfFools • today at 5:43 PM • 0 replies • view on HN

Taalas takes a similar approach but at a much higher level of complexity - instead of an array of nnn tiny specialized cryptographic cores running the same algo (or a mix of several with interlocking dependencies), it freezes a single entire LLM on to one die, running inference both far faster and cooler than any general purpose compute but with the same one trick pony obsolescence drawback. Question remains whether high volume fab tech can be wrangled into a form that allows this approach to drop unit costs near "disposable/recyclable" levels of cheapness per chip. This also may not matter when models all start to converge on a 'good enough' level of coverage for specific domains that the chips can remain productive for 3-4 years before needing a recycle.