The glossary
Every word you'll meet in AI and machine learning, explained in everyday language.
A table of every output's slope with respect to every input of a function. For a layer z = Wx, it's the weight matrix W itself.
For a function f from n inputs to m outputs, the Jacobian J is an m × n matrix: row i holds the gradient of output i, and column j says how every output responds to input j.
Then add a third number to each line of matrix W, 4 on the first line, 0 on the second and 2 on the third, and press Use these numbers: a third input, so the grid gains a third column.
Jacobians and Hessians · Slopes of vector functions, a layer's Jacobian, second partials, and bowls, domes and saddles. About 42 minutes.
1286 terms in the glossary, each with the lesson that teaches it.
Every word you'll meet in AI and machine learning, explained in everyday language.
Slopes of vector functions, a layer's Jacobian, second partials, and bowls, domes and saddles.
Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write