logoalt Hacker News

zozbot234yesterday at 12:08 PM0 repliesview on HN

NPUs are more useful for prefill than decode anyway. Memory bandwidth is not the bottleneck for prefill.