Index Ai Academy
Glossary · Phase 6 · Modern LLM engineering

Steering vector

Also written: steering vectors

A direction added to a model's residual stream while it runs, to push its behavior one way. The weights don't change, and the effect varies from input to input.

Try it now

The dot product with a unit direction is how far a reaches along it. Subtracting that part is the projection.

Learn it properly

Directions: steer the run or edit the weights · Find a behavior's direction in the residual stream, add it at run time, project it out of the weights, and see the effect change from input to input. About 40 minutes.

Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 6 · lesson 40 min

Directions: steer the run or edit the weights

Find a behavior's direction in the residual stream, add it at run time, project it out of the weights, and see the effect change from input to input.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write