> What do we have, no programmers, no one knowing what’s going on inside the test passing slopy black box, except a caretaker guy who’s kept their skills sharp by not using AI—with their time taken up trying to understand constantly rewritten code?

That's where we're headed but I'd say the smart teams will have that 'caretaker guy' use judgment to know when and when not to apply AI. That describes one of my businesses perfectly [1].

[1] https://lattice.engineering