Index Ai Academy
Glossary · Phase 2 · Math for ML engineers

Log-sum-exp

The stable way to compute log(sum(exp(x))): subtract the largest value first, then add it back.

Try it now

Then set the numbers to 0.5, 0.25 and 0.125 and press Use these numbers. The sum of logs stays an ordinary number.

Learn it properly

Floating point and log space · Growth, decay, and why logs turn products into sums. About 35 minutes.

Other terms from the same lesson

  • exponential: Growth by repeated multiplying, like doubling every step.
  • logarithm: The reverse of an exponential: how many times you multiply to get a number. log₁₀(1000) is 3.
  • natural logarithm: The log that undoes e to a power: ln(x) asks "e to what power gives x?" So ln(e) is 1 and ln(1) is 0.
Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write