Multiplication Theorem of Probability Explained Simply
The multiplication theorem of probability answers the and-question: what is the probability that two events both happen? You take the probability of the first event, then multiply by the probability of the second in the world where the first has happened. When the events are independent, the first does not change the second, so it simplifies to P(A ∩ B) = P(A) × P(B).
This theorem matters because naive multiplication is a trap. Drawing two aces from a deck without replacement is not (4/52) × (4/52), because after the first ace only 3 aces remain among 51 cards. The conditional factor P(B | A) captures exactly how the first event reshapes the situation for the second. Combined with the addition theorem, it handles any mix of and and or, and it is the engine inside tree diagrams, total probability and Bayes theorem.
Key Concepts
- Intersection A ∩ B: the event that A and B both occur, read as A and B.
- Conditional probability P(B | A): the probability of B given A has occurred; the second factor in the general formula.
- Independent case: when A does not affect B, P(B | A) = P(B), giving the simple product P(A) × P(B).
- Dependent case: when A changes the setup, for example sampling without replacement, the conditional factor differs from P(B).
- Extension to three events: P(A ∩ B ∩ C) = P(A) × P(B | A) × P(C | A ∩ B), chaining the conditions.
Formulas
General form: P(A ∩ B) = P(A) × P(B | A) = P(B) × P(A | B). For independent events: P(A ∩ B) = P(A) × P(B). For three events: P(A ∩ B ∩ C) = P(A) × P(B | A) × P(C | A ∩ B). For n independent events the probability all occur is the product of the n individual probabilities. P(A) must exceed 0 for the conditional factor to be defined.
Worked Example
Two cards are drawn one after another from a 52-card deck without replacement. Find the probability both are aces. Let A be the first card is an ace and B the second is an ace. P(A) = 4/52. Given A, 3 aces remain among 51 cards, so P(B | A) = 3/51. Then P(A ∩ B) = (4/52) × (3/51) = 12/2652 = 1/221, about 0.0045. Direct counting agrees: C(52, 2) = 1326 pairs and C(4, 2) = 6 all-ace pairs give 6/1326 = 1/221. The naive product (4/52) × (4/52) = 1/169 wrongly assumes the second draw still sees 4 aces.
Common Misconceptions
- Multiply the original probabilities for any and-question: Valid only for independent events. For sampling without replacement or linked events, use the conditional probability.
- Order does not matter in the formula: P(A) × P(B | A) equals P(B) × P(A | B) numerically, but the conditional factors differ, so pick whichever order is easier to think about.
- Independent means mutually exclusive: Unrelated ideas. Independent events can both happen; mutually exclusive events cannot.
Real-World Applications
Medical testing uses it for the probability of two consecutive positive results. Machine learning classifiers built on naive Bayes multiply conditional probabilities exactly this way, and geneticists multiply trait probabilities across independent genes.
The multiplication theorem states P(A ∩ B) = P(A) × P(B | A), reducing to P(A) × P(B) for independent events. The conditional factor adjusts for how the first event changes the second, essential for sampling without replacement. Extended to chains of events, it is the foundation of tree diagrams, total probability and Bayesian updating.
Related blogs
- Random Experiments & Sample Space: Probability Start
- Types of Events in Probability: Simple, Compound & More
- Classical Definition of Probability: Explained with Examples
- Axiomatic Approach to Probability: Explained with Examples
- Addition Theorem of Probability: Explained with Examples
- Conditional Probability: Concepts, Formulas and Examples