logoalt Hacker News

coherentponytoday at 1:50 PM1 replyview on HN

You can saturate the entire power budget on pretty much all GPUs just by moving data in and out of HBM. There is no compute needed at all to do this, and bandwidth bound workloads are extremely common in the scientific computing space.


Replies

grunder_advicetoday at 2:43 PM

Thanks for the correction, I guess I was mistaken. I always had this mistaken belief that moving data is less energy intensive.