"Machine learning architecture is second nature to us AI researchers, so it's easy to forget that the average person probably only knows the formulas for gradient descent and ReLU."

"And softmax of course."