alt Hacker Newsneat, combining info from two phrases is hard to see without such a tool.
are you worried later-layer attention gets drowned out by earlier layers just because there are more of them contributing to the sum?
neat, combining info from two phrases is hard to see without such a tool.
are you worried later-layer attention gets drowned out by earlier layers just because there are more of them contributing to the sum?
Hmm, I might try to add some controls to limit which layers get summed up. It might be able to reveal more patterns.
Right now only simple correlations are visible.