logoalt Hacker News

modeless10/01/20244 repliesview on HN

Kingma is most notable for writing one of the most cited papers in AI. Actually one of the most cited scientific papers ever published, right up there with the transformers paper if not higher. "Adam: A Method for Stochastic Optimization" https://arxiv.org/abs/1412.6980

I remain astonished that Adam continues to be the most widely used optimizer in AI 10 years later. So many contenders have failed to replace it.


Replies

LarsDu8810/01/2024

The number of papers that use it exceed the number of papers that cite it probably by 100x!

p1esk10/01/2024

In my opinion, he is more notable for inventing a variational autoencoder.

supafastcoder10/01/2024

I mean, there’s only so many ways to optimize a black box

OutOfHere10/01/2024

(delete)

show 1 reply