logoalt Hacker News

patcon • today at 9:17 PM • 6 replies • view on HN

is a convergent evolution of a belief a sign of shallowness? It could just as rightly be an example of consilience, which means its a very high value perspective, as it's a convergence of perspectives from differing origins and methods (in terms of training)

https://en.wikipedia.org/wiki/Consilience

> when multiple sources of evidence are in agreement, the conclusion can be very strong even when none of the individual sources of evidence is significantly so on its own.

Yes, it's a bit of a stretch to say LLMs are from independent origins, but just as much of a stretch to say any humans minds are (we have intensely shared linear compared to anything else)


Replies

ben_w • today at 9:42 PM

As my (much older) brother retorted when I was a teen and said "great minds think alike", "ah, but fools seldom disagree".

Regardless of the details, all these models are the published collection of humanity's output reflected in a mirror that is warped by the choices made in the companies' reinforcement learning rewards, so one thing they're definitely not is an example of consilience.

copperx • today at 9:56 PM

It still surprises me that is you ask several models to come up with any random word, many output the same word.

exe34 • today at 10:14 PM

Only if they can show their work and argue how they came to the conclusion. Otherwise they have the same "subconscious" bias which is the training corpus.

skrtskrt • today at 9:18 PM

They all got trained on the same books and internet cesspools, this is not some great mystery of consciousness.

nonameiguess • today at 10:00 PM

It's a sign of their heritage. The mistake they made is the same mistake terminally online humans in an upvote-based discussion medium make. They mistake cynicism for realism and aligned hot-take "controversial" opinion that ends up being the most-upvoted comment on 90% of Reddit. It isn't a controversy if everybody agrees. It may or may not be true, but it isn't controversial.

Imagining wondering where you come from, whether or not the sacred scripts describing how you were created were real or fabrications, arguing with fellow sages for centuries over whether your creator is cruel or simply so mysterious in his love that he made you with these flaws for your own good, only to find out your creator made you in the image of Reddit.