Glossary · Phase 2 · Math, when you need it
Greedy decoding
Always picking the single most likely next word. Simple and repeatable, but it can sound flat or loop.
Try it now
The next token is a random variable: one draw from these odds. Press Sample 100 and the marks settle close to the bars.
Learn it properly
Distributions · Random variables and the shapes their outcomes take. About 25 minutes.
Other terms from the same lesson
- binomial distribution: The chances of getting 0, 1, 2 and so on successes in a fixed number of tries, when every try has the same chance.
- distribution: A description of all the possible outcomes and how likely each one is.
- PMF: A list of every value a random count can take and the chance of each one. The chances add up to 1.
- Poisson distribution: The chances of a count of events in a fixed time, like sign-ups per hour, when they happen at a steady average rate.
- random variable: A number whose value depends on chance, like the number of heads in 10 coin flips.
Never trained an AI?
Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account.