logoalt Hacker News

JTbanetoday at 2:08 PM2 repliesview on HN

No AI company is addressing the elephant in the room that you need someone experienced constantly monitoring any agentic workflows. This means that the cost savings of agents are a myth.

My company actually did an internal study of agent usage for coding and found it only improved productivity by 10-20%, basically on the same level as good code templates or an autocomplete.


Replies

ACCount37today at 4:09 PM

Less and less true with every new generation of AI systems.

AI gets better and better at operating self-supervised, and the amount of skill needed to supervise an AI in a useful fashion only ever goes up.

show 1 reply
disgruntledphd2today at 2:48 PM

> My company actually did an internal study of agent usage for coding and found it only improved productivity by 10-20%, basically on the same level as good code templates or an autocomplete.

That's still a pretty good outcome. 20% more output across a company is huge when you think about it. Definitely not going to change the world completely though.

> No AI company is addressing the elephant in the room that you need someone experienced constantly monitoring any agentic workflows. This means that the cost savings of agents are a myth.

I mean, it depends on the agentic workflow. Like for production code, definitely. For document and claim review, you probably need a targeted sample on a daily basis but you get massive gains.