This brings up a much larger discussion. How bad are LLMs at engineering? Would you trust one to build a high voltage circuit? How about a bridge?
I don't trust an LLM to write software for me without human verification, but it's not like it's that hard to verify what it writes if you understand how to write code yourself. I expect even when an LLM can layout a high voltage circuit or design a bridge that most organizations who carry liability would still be sure to audit the design with a set or two of intelligent and trained human eyes.
The trick is, LLMs are only as good as they are at writing code because of all the publicly available source code, tutorials, blog posts and Q&A it can slurp up.