Letters in the power: exponentials and logarithms
Why this matters
When the letter you want is a power, as in money growing at 5% a year for n years, no root can reach it. Logarithms can: a log turns a power into a multiplier, and transposing with the four moves takes over. And when the letter is inside a log, raising to the matching power frees it. This pair of opposites runs through growth and decay, half-lives, learning-rate schedules, and the logit that undoes the sigmoid at the end of every classifier.
- Free a letter that is a power by taking logarithms of both sides, so the power comes down as a multiplier
- Free a letter inside a logarithm by raising the log's base to both sides
- Tell the two cases apart in A = P(1 + r)ⁿ: the letter in the power needs logs, the letter in the base needs a root
- State the conditions: logs only of numbers above 0, and a base above 0 and not 1
- Turn growth, decay, learning-rate schedules, the sigmoid and perplexity around for the letter you need
The math: logs bring a power down
Purpose. Free a letter that sits in a power, or inside a log.
| Done to the letter | Undone by |
|---|---|
| 10 to the power x | log₁₀ |
| e to the power x | ln (the log with base e) |
| b to the power x | log with base b, or any log, divided by log b |
| log or ln of x | raise the base to that power: 10ʸ or eʸ |
The key law is log(aⁿ) = n·log a: a log brings a power down to an ordinary multiplier. So in y = a·bˣ, divide by a, giving bˣ = y/a, then take logs of both sides: x·log b = log(y/a). Divide: x = log(y/a)/log b. Any base of log works, as long as you use the same one on top and bottom.
Conditions. Logs exist only for numbers above 0, so y/a must be positive. The base b must be above 0 and not 1, since a base of 1 stays 1 whatever the power.