The glossary
Every word you'll meet in AI and machine learning, explained in everyday language.
Scoring several waiting requests in one model call, so the call's fixed overhead is shared between them.
Ask when the inputs exist and how old an answer may be. If neither forces your hand, choose batch.
Batch and online inference · Predict ahead of time or on request: when the inputs exist, latency near a server's limit, batching what waits, cost, and a hybrid with a freshness limit. About 40 minutes.
1286 terms in the glossary, each with the lesson that teaches it.
Every word you'll meet in AI and machine learning, explained in everyday language.
Predict ahead of time or on request: when the inputs exist, latency near a server's limit, batching what waits, cost, and a hybrid with a freshness limit.
Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write