https://blog.katanaquant.com/p/your-llm-doesnt-write-correct...

It can generate plausible code because the examples are already in the training set, the documentation, the how-to-write-a-database, other databases, etc.

But unless you could write SQLite yourself it will be hard to specify a good one and to get the generator to produce a correct implementation.