> but rarely a lively discussion on what he's "invented".

Go back a few years. You're biased by transformers. Before them everyone was talking about LSTMs. Not that that's the only thing he's done either