lol. Interesting stuff but here I was thinking this was about the new transformer architecture.
Differential Transformer https://arxiv.org/abs/2410.05258
Why do you think I submitted this ;-)
Likewise. I was pleased to find this instead.
Why do you think I submitted this ;-)