The glossary
Every word you'll meet in AI and machine learning, explained in everyday language.
A direction added to a model's residual stream while it runs, to push its behavior one way. The weights don't change, and the effect varies from input to input.
The dot product with a unit direction is how far a reaches along it. Subtracting that part is the projection.
Directions: steer the run or edit the weights · Find a behavior's direction in the residual stream, add it at run time, project it out of the weights, and see the effect change from input to input. About 40 minutes.
1286 terms in the glossary, each with the lesson that teaches it.
Every word you'll meet in AI and machine learning, explained in everyday language.
Find a behavior's direction in the residual stream, add it at run time, project it out of the weights, and see the effect change from input to input.
Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write