alt Hacker NewsThere was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
That's the wake sleep algorithm for undirected graphical models.
Hinton had a course on Coursera around 2015 that covered a lot of pre NN deep learning. Sadly I don't think it's up anymore.