logoalt Hacker News

vanuatutoday at 1:16 AM0 repliesview on HN

https://metr.org/blog/2026-02-24-uplift-update/

This is probably the best one for coding? The two main findings are that developers didn't want to do tasks without AI (implication being that they would find it too tedious) and for the tasks that were measured, there was a speedup (and more of a speedup if you had more experience with AI tools)

Unfortunately "productivity" is very hard to measure directly. I prefer looking at how much money companies are paying Applied AI companies (a lot) because in aggregate, that meant these companies justified ROI vs. OpenAI/Anthropic directly, and sufficiently enough that large enterprises are willing to go through the time and money to spend on a vendor. It's not foolproof but it dampens the effect of companies tokenmaxxing their Codex/Claude Code to look productive.