alt Hacker NewsVery cool project.
> Backpropagation (gradients derived by hand)
What does by hand mean in this context?
Also how did you write the readme? It's a curious blend of human and AI writing.
Very cool project.
> Backpropagation (gradients derived by hand)
What does by hand mean in this context?
Also how did you write the readme? It's a curious blend of human and AI writing.
The fact that by hand is emphasized so often and so often (see src/handgpt.h comments as well above backward()) makes me think it's AI.
Anyways, it looks like gradients derived by hand means they didn't use autograd. They have written out the expression for dL/dW themselves.