Are you sure about this?

LLMs are like a topographic map of language.

If you have 2 known mountains (domains of knowledge) you can likely predict there is a valley between them, even if you haven’t been there.

I think LLMs can approximate language topography based on known surrounding features so to speak, and that can produce novel information that would be similar to insight or innovation.

I’ve seen this in our lab, or at least, I think I have.

Curious how you see it.