Index Ai Academy
Glossary · Phase 6 · Modern LLM engineering

Task arithmetic

Merging by adding fine-tunes' task vectors to the base model at a chosen strength. With two models at half strength, it is their plain average.

Try it now

Two toy task vectors in two dimensions. Their sum is the merge at strength 1; half the sum is the average.

Learn it properly

Merging models · Average two fine-tunes, add their task vectors, try SLERP, TIES and DARE, measure the interference, and compare with a model trained on both tasks. About 40 minutes.

Other terms from the same lesson

  • model merging: Combining several fine-tunes of one base model into a single model by arithmetic on their weights, with no training.
  • model soup: The average of several fine-tunes of one base model on the same task. It often works as well as any one of them, because they sit close together.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 6 · lesson 40 min

Merging models

Average two fine-tunes, add their task vectors, try SLERP, TIES and DARE, measure the interference, and compare with a model trained on both tasks.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write