> Due to the nature of how an LLM works, it cannot make anything truly new, it, again, can only recombine and remix things from it's training data
Fwiw, David Hume made this exact argument about human imagination:
> But though our thought seems to possess this unbounded liberty, we shall find, upon a nearer examination, that it is really confined within very narrow limits, and that all this creative power of the mind amounts to no more than the faculty of compounding, transposing, augmenting, or diminishing the materials afforded us by the senses and experience. [David Hume — An Enquiry Concerning Human Understanding (1748), Section II, Paragraph 5]