Counterpoint: software has always had bugs. People are fallible.

Perhaps designing with assumptions that the entire stack is imperfect is the route to higher quality, along the lines of chaos monkey, which randomly kills processes on production boxes… which ensures resilience is real.

Even without AI our tech stack is so deep it’s hard to imagine every feature at every layer being provably correct.