The glossary
Every word you'll meet in AI and machine learning, explained in everyday language.
One decision repeated many times: choose among options with unknown payouts, see only the reward of the one chosen, and try to collect as much as possible.
The names come from slot machines, once called one-armed bandits: a row of machines with different payouts and a player deciding which arm to pull. So this is a multi-armed bandit. Each option is an arm, a choice is an action, and what comes back, 1 for a click and 0 for none, is the reward.
Each step is smaller than the last, because each new reward is a smaller share of what has been counted.
Bandits: explore or exploit · Learning from rewards with no labels: a running estimate for each option, why the greedy choice gets stuck, epsilon-greedy and an optimism bonus. About 35 minutes.
1286 terms in the glossary, each with the lesson that teaches it.
Every word you'll meet in AI and machine learning, explained in everyday language.
Learning from rewards with no labels: a running estimate for each option, why the greedy choice gets stuck, epsilon-greedy and an optimism bonus.
Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write