logoalt Hacker News

AlexCoventryyesterday at 11:01 PM0 repliesview on HN

What's the advantage of having multiple channels with separate residual connections? Why not just concatenate those channels, and do residual connections on the concatenated channel?