I mean seriously is this the prediction folks are going with? Ok so we can build something like our SOTA coding agents today, breathing life into these things that 3 years ago were laughable science fiction, and your prediction is it will be worse from here on out? Do you realize coding is a verifiable domain which means we don’t technically even need any human data to improve these models? Like in your movie of 2050 everyone’s throwing their hands up “oh no we made them dumber because people don’t need to take 8 years of school and industry experience to build a good UI and industry best practice backend infrastructure”. I guess we can all predict what we want but my god
> breathing life into these things that 3 years ago were laughable science fiction
LLMs were not fiction three years ago. Bidirectional text encoders are over a decade old.
That's an INCREDIBLY good point about synthetic training data. During model training, AI agents could pretty much start their own coding projects, based on AI-generated wish-lists of features, and verify progress on their own. This leads to limitless training data in the area of coding.
Coding might be cooked.