logoalt Hacker News

hervature • 04/23/2025 • 0 replies • view on HN

Neural network training is harder when the input range is allowed to deviate from [-1, 1]. The only reason why it sometimes works for neural networks is because the first layer has a chance to normalize it.