> But a demo is not a system. A demo is controlled. The input is clean, the edge cases are removed, and the happy path is selected in advance. Real work has missing data, unclear requests, old records, broken integrations, private context, bad formatting, vague instructions, and exceptions nobody wrote down.
This has been the case for decades. LLMs are just magnifying it.
That's why I feel that an important part of any engineer's development, should be working on shipping product; where they can have firsthand experience with its use "in the wild."
It can be sobering; sometimes, downright depressing.
But it's a great lesson.
Nothing teaches you like maintaining something for a decade
This is definitely the case with ERP/accounting systems. AI can make the demo look better, but someone inside the company still has to own each process.
I’ve found that no matter what systems companies implement, behind the scenes they usually still run on spreadsheets. Moving people away from that is where the pushback starts.