Index Ai Academy
Glossary · Phase 11 · Professional practice

Successive halving

A search that gives every configuration a small budget, keeps the better half, doubles the budget and repeats until one is left.

Try it now

Each new setting multiplies the bill. Each new value raises the base.

Learn it properly

Hyperparameter search · What a grid costs, random search on a log scale, stopping weak settings early, and why the winner's validation score flatters it. About 40 minutes.

Other terms from the same lesson

  • log-uniform: Drawing a value so that each factor of ten is equally likely, by drawing its exponent evenly. Used for learning rates and regularization strengths.
  • random search: Tuning a model by drawing every setting at random from a range for each run. Each run tries a new value of every setting.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 11 · lesson 40 min

Hyperparameter search

What a grid costs, random search on a log scale, stopping weak settings early, and why the winner's validation score flatters it.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write