alt Hacker NewsHow is this different from human brains being made up of a finite number of neurons in a finite number of configurations? I know very little about LLMs and nothing about neurology and maybe you can explain to me why one is so much more powerful than the other.
Replies
As I understand it, the advantages of AI have not just been speed of processing.
Humans have cognitive limits. Humans hold a specific slice of all knowledge at a time and necessarily limits what correlations can be leveraged. This is similar to "context windows" in modern AI. Human minds are wildly variable in efficiency. AI is has constant inefficiency, largely controlled by the speed of light, physical RAM, and processing power, with superior (no cost) "thought" context switching. The AI also has superior accuracy without the need for "concentration" because the AI is processing on a Turing machine with the limited operations that it's superior at in terms of time and energy - eg find an element in a list of 1 million elements.
> a finite number of neurons in a finite number of configurations
Neurons and synapses change, especially synapses (the connections between neurons). Some neurons have a few connections to other neurons. Others have hundreds of thousands of connections to other neurons. These grow and change. "Estimates are between 100 trillion and 1,000 trillion neural connections" Is it finite? Depends on your definition of finite. If anything countable is finite, then it is finite but the number may be practically uncountable. Is it fixed? No.