Glossary · Phase 2 · Math, when you need it
Logit
A raw score a model gives each option before softmax turns the scores into probabilities.
The raw scores going in have a name: logits. A model's last layer produces logits, and softmax turns them into probabilities.
Try it now
Drag a score up and watch probability flow toward it from the others. Then move the temperature.
Learn it properly
Softmax · Turn any list of scores into probabilities. About 25 minutes.
Other terms from the same lesson
- softmax: A function that turns a list of scores into probabilities that add up to 1, keeping the biggest score biggest.
Never trained an AI?
Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account.