You don't understand Stallman then. Now you are dependent on closed source from closed source AI vendors. True software freedom would then being able to dissassemble the bot writing your code.
Even if the model was open source, nobody would still know how the generated code works. You wouldn't even really know in want interesting sense of the word why the model produced the output you got.
No one knows how the open source models work either.