Glossary · Phase 2 · Math, when you need it
Softmax
A function that turns a list of scores into probabilities that add up to 1, keeping the biggest score biggest.
Try it now
Drag a score up and watch probability flow toward it from the others. Then move the temperature.
Learn it properly
Softmax · Turn any list of scores into probabilities. About 25 minutes.
Other terms from the same lesson
- logit: A raw score a model gives each option before softmax turns the scores into probabilities.
Never trained an AI?
Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account.