Probability Fundamentals: From Coin Flips to Real Decisions
Probability quantifies uncertainty. Whether you are assessing risk, analyzing A/B test results, or understanding weather forecasts, probability literacy is an essential analytical skill.
Key Takeaways
- Probability ranges from 0 (impossible) to 1 (certain).
- `P(A or B) = P(A) + P(B) - P(A and B)`
- `P(A|B)` = probability of A given that B has occurred.
- Gambler's fallacy**: Past independent events do not affect future probabilities. After 10 heads in a row, the next flip is still 50/50.
- - Conjunction fallacy: P(A and B) is always less than or equal to P(A) alone.
Basic Probability
Probability ranges from 0 (impossible) to 1 (certain). For equally likely outcomes:
P(event) = favorable outcomes / total outcomes
A standard die has 6 faces. P(rolling a 4) = 1/6 ≈ 0.167 or 16.7%.
Types of Probability
| Type | Definition | Example |
|---|---|---|
| Classical | Equal likelihood assumption | Dice, coins, cards |
| Empirical | Based on observed frequency | 30% of visitors convert |
| Subjective | Personal judgment | 70% chance of rain |
Key Rules
Addition Rule (OR)
For mutually exclusive events:
P(A or B) = P(A) + P(B)
For non-exclusive events:
P(A or B) = P(A) + P(B) - P(A and B)
Multiplication Rule (AND)
For independent events:
P(A and B) = P(A) × P(B)
Two coin flips both heads: 0.5 × 0.5 = 0.25.
For dependent events:
P(A and B) = P(A) × P(B|A)
Conditional Probability
P(A|B) = probability of A given that B has occurred.
P(A|B) = P(A and B) / P(B)
Example: 5% of emails are spam. 80% of spam contains the word 'free.' What's the probability an email with 'free' is spam? This is where Bayes' theorem becomes essential.
Common Pitfalls
- Gambler's fallacy: Past independent events do not affect future probabilities. After 10 heads in a row, the next flip is still 50/50.
- Base rate neglect: A 99% accurate medical test still produces many false positives when the disease is rare (1 in 10,000).
- Conjunction fallacy: P(A and B) is always less than or equal to P(A) alone.