Contraction Mapping Theorem: Explained with Examples
A contraction is a map T on a metric space shrinking all distances by a fixed factor: d(Tx, Ty) ≤ k·d(x, y) for some constant k strictly less than 1 and every pair x, y. The Contraction Mapping Theorem (Banach fixed-point theorem) says that on a complete metric space such a map has exactly one fixed point x* with T(x*) = x*, and iterating T from any start converges to it.
This matters because many problems are fixed-point problems in disguise: solving equations, finding market equilibria, or proving a differential equation has a solution. The theorem guarantees the point exists, hands you the algorithm of plain iteration, and supplies an error estimate telling you how close you are after n steps.
Key Concepts
- Fixed point: x* with T(x*) = x*, unchanged by the map.
- Contraction constant: k with 0 ≤ k < 1 in d(Tx, Ty) ≤ k·d(x, y); smaller k means faster convergence.
- Picard iteration: x_0, x_1 = T(x_0), x_2 = T(x_1), …, shown to be Cauchy and convergent to x*.
- Completeness: required so the Cauchy iterates land on a point inside the space.
- Error bound: d(x_n, x*) ≤ k^n/(1 − k)·d(x_0, x_1); the error shrinks geometrically.
How It Works
- Iterate x_{n+1} = T(x_n) from any x_0. Consecutive distances shrink: d(x_{n+1}, x_{n+2}) ≤ k·d(x_n, x_{n+1}).
- The triangle inequality bounds the tail by a geometric series, so the iterates form a Cauchy sequence.
- Completeness gives a limit x* in the space; continuity of T lets the limit pass through, yielding T(x*) = x*.
- Uniqueness: if x*, y* are fixed, d(x*, y*) = d(Tx*, Ty*) ≤ k·d(x*, y*) with k < 1 forces d(x*, y*) = 0.
Worked Example
Take T(x) = x/2 + 1 on R. Since |T(x) − T(y)| = |x − y|/2, T is a contraction with k = 1/2. Start x_0 = 0: x_1 = 1, x_2 = 1.5, x_3 = 1.75, x_4 = 1.875, x_5 = 1.9375, approaching 2, and T(2) = 2 confirms x* = 2. The error bound gives d(x_5, 2) ≤ (1/2)^5/(1/2)·d(0,1) = (1/32)/(1/2) = 1/16 = 0.0625, and the actual error 2 − 1.9375 = 0.0625 matches the bound exactly.
Common Misconceptions
- "k ≤ 1 is enough." No: k must be strictly below 1. T(x) = x + 1 satisfies the inequality with k = 1 yet has no fixed point.
- "Any shrinking map has a fixed point." Completeness is essential: on (0, 1), T(x) = x/2 is a contraction whose only candidate fixed point, 0, is missing.
- "The starting point does not matter." Convergence holds from every start, but a close start needs far fewer steps, as the error bound shows.
Real-World Applications
- Picard–Lindelöf proves ODEs have unique solutions via a contraction integral operator, grounding models in physics and biology.
- Newton's method converges because its iteration map is a contraction near a simple root.
- Value iteration in reinforcement learning and some market equilibrium proofs rely on contraction arguments.
The contraction mapping theorem packages "distances shrink by a fixed factor" into existence, uniqueness, a universal algorithm, and a sharp error bound. It is among the most-used existence theorems in applied mathematics.
Related blogs
- The Real Number System and Field Axioms Explained Simply
- Order Axioms and Completeness: Real Numbers Full Guide
- Supremum and Infimum: Definitions, Examples and Key
- Archimedean Property: Explained with Proofs
- Sequences of Real Numbers: Convergence and Key Theorems
- Convergence and Divergence of Sequences: Notes and FAQs