Glossary · Phase 1 · Building with LLMs
Jitter
A small random extra wait added before a retry, so many programs don't all retry at the same moment.
The standard response is to wait and retry, waiting longer each time: 1 second, then 2, then 4. That's called exponential backoff, because the wait doubles each time. Real code also adds a little random extra wait, called jitter, so a thousand scripts don't all retry at the same instant. And if the API sends a
retry-afterheader, wait that long.
Try it now
Retrying a permanent error only wastes time and money.
Learn it properly
LLMs in automations · Put models inside scripts and workflow tools that run on their own. About 30 minutes.
Other terms from the same lesson
- cron: A standard way to run a program on a schedule, such as every weekday at 9 a.m.
- exponential backoff: Waiting longer after each failed try before trying again: 1 second, then 2, then 4.
- idempotent: Safe to run twice: doing it again has no extra effect, like pressing an elevator button that's already lit.
- rate limit: A cap on how many requests you may send in a set time. Go over it and the service replies with error 429.
- webhook: A web address you give another service, which it calls when something happens, such as a new order.
Never trained an AI?
Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account.