The glossary
Every word you'll meet in AI and machine learning, explained in everyday language.
The average of several fine-tunes of one base model on the same task. It often works as well as any one of them, because they sit close together.
Two toy task vectors in two dimensions. Their sum is the merge at strength 1; half the sum is the average.
Merging models · Average two fine-tunes, add their task vectors, try SLERP, TIES and DARE, measure the interference, and compare with a model trained on both tasks. About 40 minutes.
1286 terms in the glossary, each with the lesson that teaches it.
Every word you'll meet in AI and machine learning, explained in everyday language.
Average two fine-tunes, add their task vectors, try SLERP, TIES and DARE, measure the interference, and compare with a model trained on both tasks.
Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write