logoalt Hacker News

diehundetoday at 2:27 AM2 repliesview on HN

Oh right. But if all you do is reading programming books you are an amazing programmer? Where is all the training and practice LLMs did to become so good at coding?


Replies

hackinthebochstoday at 7:03 AM

>Where is all the training and practice LLMs did to become so good at coding?

Coding is a matter of translating the natural language description of a problem to the code specification while keeping the semantics fixed (and imputing the unspecified semantics as necessary). It is not considerably more difficult than translating between two dissimilar natural languages. Chess isn't a matter of language translation, but a compute heavy game of finding the best move out of many possibilities with wide variation in the quality of each move. Chess takes directed practice and reinforcement whereas language translation does not.

famouswafflestoday at 2:33 AM

LLMs (and Humans) don't get really good from programming books lol. The training and practice is the actual code they predict and learn from in the process of predicting.

show 1 reply