logoalt Hacker News

gpugreg • today at 7:26 PM • 1 reply • view on HN

How did you measure energy usage?

Edit: I found a linked article that mentions the inference provider who does the measurements.


Replies

ThibWeb • today at 7:34 PM

Yes, all from Neuralwatt, GPU energy use only. Makes models’ “efficiency” much more visible than tokens.