Index Ai Academy
Glossary · Phase 3 · Machine learning

Partition

One piece of a large table kept or processed on its own, such as one day of data.

Try it now

The mean comes from the merged summary: 320 / 12. The median needs the raw values.

Learn it properly

Data in pieces: partitions and mergeable summaries · Split, summarize and combine; which statistics merge exactly, merging variances, sketches for the rest, and partitioning well. About 30 minutes.

Other terms from the same lesson

  • HyperLogLog: A sketch that estimates how many distinct values a huge dataset has, within a few percent, using a few kilobytes.
  • mergeable summary: A summary of a partition that can be combined with another partition's to give the summary of both, such as a count, a sum, or a mean kept with its count.
  • sketch: A small, mergeable data structure that answers a question approximately, such as HyperLogLog for distinct counts or t-digest for quantiles.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write