Index Ai Academy
Glossary · Phase 1 · Building with LLMs

Held-back set

Cases you never tune against, kept to check whether an improvement is real.

Try it now

Reviews 1 to 12 are the development set; 13 to 20 are held back. The outlined cells are what version 2 changed.

Learn it properly

Improving a prompt against an eval · Change one thing, rerun, compare, read what flipped, keep or revert: the loop that makes a prompt better, with a held-back set and the error on the gap. About 30 minutes.

Other terms from the same lesson

  • development set: The cases you look at and tune a prompt against. Judge the final choice on a separate held-back set.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 1 · lesson 30 min

Improving a prompt against an eval

Change one thing, rerun, compare, read what flipped, keep or revert: the loop that makes a prompt better, with a held-back set and the error on the gap.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write