LLMs can reproduce the training data verbatim, under some circumstances. They have to be trained not to.