logoalt Hacker News

E-Reveranceyesterday at 7:12 PM3 repliesview on HN

> Residual connections are more than a trick to help gradients flow. They’re a conservation law.

> Not a hack, not a trick. A principled constraint that makes the architecture work at scale.


Replies

jszymborskiyesterday at 9:54 PM

OK, I thought I was reading too much into it but those same sentences also jumped out for me

show 1 reply
DoctorOetkeryesterday at 9:41 PM

yes this reads like classic intellectual fellicitatio

nasreddinyesterday at 11:06 PM

[dead]