Index Ai Academy
Glossary · Phase 11 · Professional practice

Manifest

Also written: manifests

A list of every file in a dataset with the hash of its contents. Its own hash is one id for the whole dataset version.

A real dataset is many files: training rows, test rows, a label list, perhaps thousands of images. One hash per file isn't a dataset version yet. The version is a manifest: a list of every path with the hash of its contents. Hash the manifest itself and you get one short id for the whole dataset.

Try it now

Content addressing in four boxes. Git, DVC and Git LFS all work this way.

Learn it properly

Versioning data and models · Files stored under the hash of their contents, a manifest that names a whole dataset, and lineage from data and code to each model. About 35 minutes.

Other terms from the same lesson

  • content addressing: Storing a file under the hash of its contents. A name can never point to different content, and identical content is stored once.
  • pointer file: A tiny text file, kept in git, that holds the hash of a large file kept in a separate store.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 11 · lesson 35 min

Versioning data and models

Files stored under the hash of their contents, a manifest that names a whole dataset, and lineage from data and code to each model.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write