Index Ai Academy
Glossary · Phase 3 · Machine learning

Brier score

The average squared gap between a predicted probability and what happened (1 or 0). Lower is better.

You check it by sorting predictions into bands and comparing, in each band, the average prediction with the share who really churned. The Brier score is a single number for the whole set: the mean of the squared gaps between each probability and the outcome (1 for churned, 0 for stayed).

Try it now

Calibration is the match between the two bars, in every band.

Learn it properly

Calibration: can the probability be trusted? · Bands of predicted risk against what happened, the Brier score, why naive Bayes is over-confident, and fixing it on rows the model did not fit. About 30 minutes.

Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 3 · lesson 30 min

Calibration: can the probability be trusted?

Bands of predicted risk against what happened, the Brier score, why naive Bayes is over-confident, and fixing it on rows the model did not fit.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write