logoalt Hacker News

Here be monsters: What do you still need to know when agents do the work?

83 points • by adrq • today at 1:23 PM • 21 comments • view on HN

Comments

trjordan • today at 2:33 PM

I like the analogy. It feels right. But I don't think it actually is, because it leans hard on the _feeling_ of failure, vs. the actual failure.

The failure that actually matters here is product failure. Angry users. Security incidents. Downtime. Broken workflows.

Stressed and uncomfortable developers have, historically, been a leading indicator of product failure. Software is complex and when devs can't handle the breadth of ownership + the depth of expertise at the same time, it means bad work that leads to product failure. It's not clear that agents fail in the same way, or that our collective intuition about how and when to trust agents is sufficiently developed to predict product failure in the same way.

As anecdata: I know a bunch of growth-SaaS/last-batch-of-IPO companies where the devs are all stressed, the feature ship rate is up, and incidents are down. All at the same time.

So yes, quick learners and just-in-time depth is important, but so is intuition about where discomfort is going to produce true failure. The discomfort isn't a feeling to throw away, simply trusting that you'll learn everything in time. Ownership requires holding a model of the system in your head and proactively steering where you dive.

➕ show 2 replies
olwmc • today at 3:01 PM

> Most of the successful engineers and engineering leaders I have had the pleasure of working with were able to hold a discussion on almost any topic, whether technical or not

Reverse Gell-man? https://en.wiktionary.org/wiki/Gell-Mann_amnesia_effect#Engl...

➕ show 1 reply
EduardLev • today at 2:45 PM

Mostly agreed with just in time learning. This is not just something that can be learned from the code though, this may require a huge amount of code context across multiple repositories and configuration files, as well as a knowledge of history, process, other tribal knowledge etc. So to me that's still the really difficult part of the job and AI definitely helps but doesn't entirely solve this. I see it often wants to solve some issue at not quite the level of depth or high level understand that you would want.

alabhyajindal • today at 4:38 PM

this is llm slop. and please don't flag me. this is useful information. i know hn has a policy of not commenting on asides like website css etc - but i believe ai written posts should be called out.

zaphar • today at 2:10 PM

I think this is probably a good way to think about it. Breadth is going to be important if you want to reasonably navigate the new world. In an emergency even if you are using an agent you will be much quicker if you know what questions to ask the agent and how to guide it.

➕ show 2 replies
guitarlimeo • today at 4:02 PM

This could be a good article but the example doesn't work?

"The CI tool was flagging an issue, perhaps correct, perhaps incorrect. But this is a real system so I had to dive in."

By diving in he ultimately just uses the AI to fix the problem:

"So I told Codex to make SonarQube happy, which it did by refactoring and splitting things up into 10 files".

Why isn't there a "shallowbot", or some CI configuration that tries to fix CI mistakes once before humans dive in? Plus it's not that deep, it's just shit code that was fixable with a "make sonarqube happy" prompt. I think the author is ashamed to admit that he's as generalist as everyone else now.

ArcaneMoose • today at 2:27 PM

> You need a high-level, far-away map of the entire system, and you need to know just enough to know where you need to dive in

One thing that puts me squarely in the Optimist camp is that such a map can often be created by AI just-in-time. Sure you might not know every detail of what it said, but you can simply follow up and build your understanding.

➕ show 1 reply
tonglingxujianx • today at 4:16 PM

[flagged]

chelseahermes • today at 2:01 PM

[flagged]

margarina72 • today at 4:35 PM

TLDR AI can write the code, but you still need enough technical knowledge to recognise bad decisions and fix problems.

rittermax • today at 3:19 PM

[flagged]