alt Hacker NewsLLM's are better at software for several reasons:
- lots of high quality training data
- automatic verfication/scoring is straightforward
- AI companies are software companies so are better at tuning LLM's for software
- the goal is AGI, where AGI means the AI can improve itself autonomously. Which requires them to be good at software
While LLM's are uniquely good at software today, they'll get better at other fields slowly as attention goes towards training in those fields.
Replies
rokhayakebe • yesterday at 10:59 PM
lots of high quality training data
This seems correct and in fields of knowledge people guard their secre, or it is not easy to extract/document knowledge, or it isn't publicly available.
Isn't the point that there aren't many other fields that check these checkboxes? Software is very unique in that it is so easily verifiable and there is a glut of training data.