Index Ai Academy
Glossary · Phase 6 · Modern LLM engineering

Forward-pass budget

Also written: forward-pass budgets

A fixed number of times an editor may run a model while working on it. It shows whether an edit was reasoned from the weights or found by trial and error.

Try it now

The cost of reading weights as text. Start: the tiny GPT at the rate from the post's logs, in a 200,000-token context window. Try 1,315 weights, then 1,000,000.

Learn it properly

The editor's harness · What an LLM that edits weights is given and what it is denied: weights as text and their cost in tokens, a sandbox, a budget of forward passes, and rules the harness enforces. About 40 minutes.

Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 6 · lesson 40 min

The editor's harness

What an LLM that edits weights is given and what it is denied: weights as text and their cost in tokens, a sandbox, a budget of forward passes, and rules the harness enforces.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write