The trick is, LLMs are only as good as they are at writing code because of all the publicly available source code, tutorials, blog posts and Q&A it can slurp up.