logoalt Hacker News

leakyfilterlast Friday at 9:17 PM0 repliesview on HN

Raw gemm computation was never the real bottleneck, especially on the newer GPUs. Feeding the matmuls i.e memory bandwidth is where it’s at, especially in the newer GPUs.