Index Ai Academy
Glossary · Phase 3 · Machine learning

Bootstrap sample

A sample of the same size as the data, drawn with replacement, so some rows repeat and others are left out.

Try it now

Learn it properly

Random forests and boosting · Many weak models voting beat one strong one. About 42 minutes.

Other terms from the same lesson

  • bagging: Training many models, each on a random resample of the data, and averaging their answers. The averaging cancels out much of each model's random error.
  • early stopping: Stopping training once the validation score stops improving, and keeping the best version so far.
  • ensemble: Several models whose answers are combined, by voting or averaging. Together they usually beat any one of them.
  • gradient boosting: Adding small decision trees one at a time, each fixing the mistakes left by the ones before.
  • out-of-bag: The rows a tree in a random forest never saw because they were left out of its bootstrap sample. Scoring on them gives a free test.
  • random forest: Many decision trees trained on different samples, voting together.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write