Index Ai Academy
Glossary · Phase 6 · Modern LLM engineering

Model patch

Also written: weight patch

A record of an edit to a model: the positions of the changed weights and their new values, with a fingerprint of the model it fits and of the model it makes.

Try it now

Six tensors of the base model, before and after the fine-tune. "What changed" shows the delta itself. Its picture is busy everywhere: no row or column was left alone.

Learn it properly

Edits are deltas: task vectors, patches and hashes · Subtract a base from a fine-tune and the edit becomes an object: scale it, take it away, ship it as a patch, and prove by hash what was applied. About 35 minutes.

Other terms from the same lesson

  • task vector: A fine-tuned model's weights minus its base model's: everything the fine-tuning changed, as one object you can scale, add or subtract.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write