logoalt Hacker News

ameliusyesterday at 9:51 PM3 repliesview on HN

"Attention is all you need" should be renamed into "Attention is sufficient but not necessary".


Replies

p1eskyesterday at 10:36 PM

It’s the opposite: attention is necessary but not sufficient.

slashdavetoday at 1:55 AM

Just about anyone building a large diffusion model is relying on transformers

ViscountPenguinyesterday at 10:25 PM

A quick look at the continuous diffusion models linked in the post shows lots of transformer models still