Index Ai Academy
Glossary · Phase 5 · Transformers

Mode collapse

When a generative model produces only part of the variety in its training data.

Try it now

Press Next. One step is a small correction. The sampler repeats it 100 times.

Learn it properly

Diffusion 2: learning to denoise, and sampling · Train a network to predict noise, then run it a hundred times from pure noise and watch a ring assemble: the sampling loop, why fresh noise goes back in, fewer steps and where they break, and a check that samples are new. About 45 minutes.

Other terms from the same lesson

  • denoiser: The network in a diffusion model. It is given a noisy example and its step number and predicts the noise that was added.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 5 · lesson 45 min

Diffusion 2: learning to denoise, and sampling

Train a network to predict noise, then run it a hundred times from pure noise and watch a ring assemble: the sampling loop, why fresh noise goes back in, fewer steps and where they break, and a check that samples are new.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write