> Residual connections are more than a trick to help gradients flow. They’re a conservation law.
> Not a hack, not a trick. A principled constraint that makes the architecture work at scale.
yes this reads like classic intellectual fellicitatio
[dead]
OK, I thought I was reading too much into it but those same sentences also jumped out for me