logoalt Hacker News

grunder_advicetoday at 1:30 PM1 replyview on HN

The trick we use at work is to take note of the instantenous power consumed. The more it's consuming the more compute it is doing. As far as macro indicators, I'm not sure you can do better than that, without profiling.


Replies

coherentponytoday at 1:50 PM

You can saturate the entire power budget on pretty much all GPUs just by moving data in and out of HBM. There is no compute needed at all to do this, and bandwidth bound workloads are extremely common in the scientific computing space.

show 1 reply