Glossary · Phase 2 · Math, when you need it
Distribution
A description of all the possible outcomes and how likely each one is.
Try it now
The next token is a random variable: one draw from these odds. Press Sample 100 and the marks settle close to the bars.
Learn it properly
Distributions · Random variables and the shapes their outcomes take. About 25 minutes.
Other terms from the same lesson
- binomial distribution: The chances of getting 0, 1, 2 and so on successes in a fixed number of tries, when every try has the same chance.
- greedy decoding: Always picking the single most likely next word. Simple and repeatable, but it can sound flat or loop.
- PMF: A list of every value a random count can take and the chance of each one. The chances add up to 1.
- Poisson distribution: The chances of a count of events in a fixed time, like sign-ups per hour, when they happen at a steady average rate.
- random variable: A number whose value depends on chance, like the number of heads in 10 coin flips.
Never trained an AI?
Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account.