alt Hacker NewsWhat? This is a massive misunderstanding. It’s easy to get truly novel ideas from LLMs, unless your definition of “new things” is so strict that no human can do so either.
The training set is about patterns, not facts or specific configurations. Yes, it’s possible to extract (some) of the training set verbatim, but that doesn’t mean it’s all you can do.
>unless your definition of “new things” is so strict that no human can do so either.
Humans rarely think of new things. We're a weak hivemind species. One or two individuals figure something out, and the rest of the troop of monkeys imitates. Brains are too fuel hungry for every brain to be innovating, "innovate and copy to the other brains" is the norm.