Glossary · Phase 5 · Transformers
Top-p
Sampling only from the most likely tokens, cutting off the unlikely tail.
Try it now
Try temperature 0.3, then 2. Then cut the list with top-k, or with top-p, and press Sample 100 to see the real draws match the bars.
Learn it properly
Sampling strategies · Temperature, top-k and top-p: turning probabilities into text. About 30 minutes.
Other terms from the same lesson
- temperature: A setting for how adventurous a model's word choices are: low is predictable, high is varied.
Never trained an AI?
Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account.