More than that, real neurons don’t behave anything like the ones we model in neural networks - real ones signal with pulses, in a manner where the timing seems as significant as the magnitude of the impulse. Typically simulated neural networks use continuous analog values instead of pulses and a sigmoid function to shape the output.
Basically, the “wiring” might be the same but nothing beyond that is.
- - -
Actually, I may have spoken too soon. Looking over the code this does look like it implements spikey activation, which is more similar to living neurons. You are correct they don’t have the original weights though - in as much as the concept maps to biology.
I am curious if this has a way to dynamically modify the weights as it runs - I consider that a major missing gap between real brains and computer simulated neural networks.
alt Hacker News
More than that, real neurons don’t behave anything like the ones we model in neural networks - real ones signal with pulses, in a manner where the timing seems as significant as the magnitude of the impulse. Typically simulated neural networks use continuous analog values instead of pulses and a sigmoid function to shape the output.
Basically, the “wiring” might be the same but nothing beyond that is.
- - -
Actually, I may have spoken too soon. Looking over the code this does look like it implements spikey activation, which is more similar to living neurons. You are correct they don’t have the original weights though - in as much as the concept maps to biology.
I am curious if this has a way to dynamically modify the weights as it runs - I consider that a major missing gap between real brains and computer simulated neural networks.