Glossary · Phase 4 · Deep learning
Autograd
Software that works out gradients automatically from the computation graph, so you never do it by hand.
Try it now
This is all of backpropagation: one small rule per operation, and the right order.
Learn it properly
Build an autograd engine · Write backprop yourself in ~100 lines (micrograd). About 40 minutes.
Other terms from the same lesson
- closure: A small function that remembers the values around it when it was made. Autograd stores one per operation to run its backward step later.
Never trained an AI?
Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account.