alt Hacker NewsI see this take frequently; that coding does not require general intelligence. Perhaps I am in the minority, but rarely do I find myself in coding situations that are completely divorced from other subject areas. The code is modeling or interacting with the world, either through business processes, or (in my case) simulating the physical world, and I need the agent to have some working knowledge of not just the code, but also physics, materials, or social conventions. Are you all really able to just "write code" without dealing with all the externalities?
Replies
Are you approaching it like programming? I first design the program I want it to write, and then let the LLM implement it. All the important decisions it has to make are contained in the design. The LLM only has to know programming and a little bit of algorithms to implement it.
How often you needed the coding AI know all the trivia about some metal band? Like who are the members, songs , years etc. You can't even be sure if the facts are correct . This are good for a generalist model where you say remember some scene from music video and the AI will find the video for you.
Sure some world knowledge like things are affected by gravity, how people function, how a society function I think is needed for a coding AI but not trivia.
The externalities have to be dealt with using human judgment. Ai can help organize data to make better judgements but that use case is taken by chat based AI.
By the time, we want to code, the scope has been limited pretty greatly to the point that my rule to the Ai is “don’t make any decisions outside of the plan, if something in the plan turns out to be untrue or cannot be implemented after 2 differing attempts stop and ask for clarification”.
Sub frontier level Ai can circle endlessly thanks to a bad assumption, but a human can cut through that by coming at the problem sideways.