logoalt Hacker News

scottyah • yesterday at 11:50 PM • 3 replies • view on HN

People tend to do wonderfully at whatever metric they're judged by. I don't think the "tokens consumed" metric was a very good one.


Replies

flowerthoughts • today at 5:37 AM

From what I could tell, it probably even distracted from the metrics that traditionally matter. I seem to remember tokenmaxxing dashboards being built, and other "shovels."

pitched • today at 12:54 AM

Completely anecdotal but I did find the better engineers tended to take to the AI tools quickest. At the beginning, tokens was probably a good way to pick them out. “Good” being entirely subjective around a product focus/mindset. If you ever find a good metric like that, it is critically important to never tell anyone, else it will quickly become not good.

jedmeyers • yesterday at 11:56 PM

> I don't think the "tokens consumed" metric was a very good one.

When mid or high level tech leadership pushes from top-down new things, that look dumb to the engineers, the leadership is either stupid or there are hidden incentives that regular people don't see. In my experience mid level usually matches with the former, and top level with the latter.