logoalt Hacker News

throwawayffffastoday at 2:21 PM1 replyview on HN

Assuming 30% gpu power utilization because of all the loading and unloading 29.2 kJ per token


Replies

donquichottetoday at 3:16 PM

Damn 15 AK47 bullets per token