> bespoke little programs that do one thing and can be discarded after use.

That's my best-case scenario as well: LLMs are scripting languages for a broader audience. They just barely automate busywork, but are not a reliable foundation.