alt Hacker NewsOk but it's already known that you shouldn't initialize your network parameters to a single constant and instead initialize the parameters with random numbers.
Ok but it's already known that you shouldn't initialize your network parameters to a single constant and instead initialize the parameters with random numbers.
The model can converge towards such a state even if randomly initialized.