logoalt Hacker News

cestithtoday at 5:54 PM0 repliesview on HN

If we're all using distilled open-weight models in ASICs in our own systems the energy cost will come way down. The question is when that becomes a reasonable solution for a broad set of use cases.