> Everyone can treat the project as a black box, and focus on observable changes to the project's behavior.
This is a good thing. I don’t need to focus on oil refineries when I fill my car with gas. I don’t know how to run a refinery, and don’t need to know.
Someone somewhere knows though.
> This is a good thing. I don’t need to focus on oil refineries when I fill my car with gas. I don’t know how to run a refinery, and don’t need to know.
No, it isn't. If you do not know what the project does, you are unable to even review the changes proposed by a coding agent.
Consequently, we already have a long track record of LLMs introducing vulnerabilities.
LLMs are great at speeding up small tasks but the trade-off is that developers become progressively clueless.