Standing in for a curve near a point
Why this matters
Up close, every smooth curve looks like a straight line: its tangent. That simple fact is how calculus turns hard problems into easy ones. Near a point, replace the curve by its tangent line and you can predict values with one multiplication; add a curvature term and the prediction gets better still. The catch is the word "near": the farther you go, the worse the stand-in. Gradient descent relies on exactly this. Each step trusts the tangent's promise that moving downhill lowers the loss, and that promise only holds for small steps. This lesson builds the approximation, measures its error, and works out how long a step can be before the promise breaks.
- Approximate a curve near a point by its tangent line: f(a) + f′(a)(x − a)
- Add a curvature term, ½f″(a)(x − a)², for a closer fit
- Measure how the error grows as you move away from the point
- See why learning rates must be small: a step only lowers the loss while the tangent is still right
The math: the tangent as a stand-in
Purpose. Replace a hard function by an easy one, near a point.
Near x = a, a smooth curve stays close to its tangent line. So for x near a:
In plain words: start at the known value, and add the slope times how far you've moved.
This is lesson 72's Δy ≈ f′(x)·Δx, written as a function of x. For √x near a = 4: f(4) = 2 and f′(4) = 0.25, so √4.1 ≈ 2 + 0.25 × 0.1 = 2.025. The true value is 2.024846: off by about 0.00015.