logoalt Hacker News

lukeinator42today at 2:20 AM0 repliesview on HN

There is a lot of interesting research into predictive coding as an alternative means to solve the credit assignment problem that might be a more plausible model of what happens in the brain.

I really liked this paper that showed using a predictive coding learning rule leads to the exact same gradients as backprop in arbitrary networks:

Predictive Coding Approximates Backprop Along Arbitrary Computation Graphs https://direct.mit.edu/neco/article/34/6/1329/110646/Predict...