Index Ai Academy
Glossary · Phase 2 · Math for ML engineers

Markov chain

Also written: Markov chains

A process that moves between states, where the chance of each next state depends only on the current one.

Picture a board game where your next square depends only on the square you're standing on and a roll of the dice. How you reached that square makes no difference. That one idea defines a Markov chain.

Try it now

Then set the vector to 0.5, 0.5 (a coin flip about today): the first answer becomes 0.6.

Learn it properly

Markov chains · States, a table of what comes next, the chance of a path, and where a chain settles. About 38 minutes.

Other terms from the same lesson

  • Markov property: The rule that what happens next depends only on the current state, not on how the process got there.
  • stationary distribution: A set of chances over a chain's states that one more step leaves unchanged: the long-run share of time in each state.
  • transition table: A table with one row per current state, holding the chance of each next state. Every row adds up to 1.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 2 · lesson 38 min

Markov chains

States, a table of what comes next, the chance of a path, and where a chain settles.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write