Mental model
Causal Effect
The specific impact an action has on an outcome, measured by comparing what happened to what would have happened without that action.
Discover
A city installs new bike lanes. A year later, traffic congestion has decreased by 10%. What can we confidently say caused this change?
Select the most accurate conclusion:
Let's unpack what it truly means to establish a cause.
Understand
Understand
A causal effect is the difference between an outcome after an action and the counterfactual—what would have happened without that action. For instance, the causal effect of taking aspirin is the pain relief you feel compared to the headache you would still have. Because we can't observe the counterfactual, we must find clever ways to estimate it. Try this: When you see a change, ask what would have plausibly happened if no action was taken.
Full explanation
Full explanation
The core of understanding a causal effect lies in the concept of the counterfactual. Since we can't observe the same situation with and without an intervention at the same time, we must find ways to approximate this 'what if' scenario.
This is why correlation is not causation. Observing that traffic decreased after bike lanes were installed doesn't prove the lanes were the cause. Perhaps the city also launched a new bus line, or a major employer switched to a remote work policy. These are confounding variables that offer alternative explanations for the outcome.
To isolate a causal effect, researchers use methods to create a credible comparison group. The gold standard is a Randomized Controlled Trial (RCT). For example, a company uses an A/B test to measure the causal effect of a new website button. By randomly showing half its users the new button (treatment group) and half the old button (control group), it can isolate the button's impact on clicks, since all other factors are, on average, equal between the groups.
In daily life, we can apply this thinking by looking for natural experiments or comparison groups. Before concluding that your new marketing campaign caused a sales spike, check if your main competitor simultaneously ran out of stock. The competitor's issue provides a strong alternative explanation for your success, making the causal effect of your campaign uncertain.
Research
Research
Modern causal inference is built on the Potential Outcomes Framework, which defines a causal effect as the difference between an outcome with a treatment and its potential outcome without it (the counterfactual). The core challenge is that the counterfactual is unobservable, making it a missing data problem. Major contributions to this field include:
- Rubin (1974): Formalized the potential outcomes model, defining the individual causal effect and framing the central challenge as one of missing data. [1]
- Pearl (2009): Developed a complementary graphical framework using Directed Acyclic Graphs (DAGs) to make causal assumptions explicit and identify confounders. [2]
- Angrist & Pischke (2009): Advanced the 'credibility revolution' by promoting robust empirical methods like natural experiments to credibly estimate causal effects from real-world data. [3]
Limitations
Limitations
The primary limitation is the fundamental problem of causal inference: for any individual, we can never observe both their outcome with treatment and their outcome without treatment at the same time. All statistical methods, including randomized trials, are attempts to estimate the average causal effect across a population, not the precise effect on a single individual. Furthermore, causal claims are only as strong as the assumptions they are built on; if you fail to account for a key confounding variable, your estimate of the effect will be wrong.
Try it
Synthesize
Choose a pattern from the guide, then pick an action to try with it.
Which pattern stands out?
What will you try?
Choose a pattern above to select an action.
Sources
Sources
- [1] Estimating Causal Effects of Treatments in Randomized and Nonrandomized StudiesDonald B. Rubin - 1974
- [2] Causality: Models, Reasoning, and InferenceJudea Pearl - 2009
- [3] Mostly Harmless Econometrics: An Empiricist's CompanionJoshua D. Angrist & Jörn-Steffen Pischke - 2009
- [4] Causal Inference: What IfMiguel A. Hernán & James M. Robins - 2020
Try it
Check your understanding
A manager sends her team to a training program, and productivity increases afterward. To understand the training's causal effect, what is the crucial question to ask?
Show the guide's explanation
Answer: What would the team's productivity have been if they *hadn't* gone to the training?
The causal effect is the difference between what happened and the counterfactual (what would have happened otherwise). Simply comparing before and after isn't enough, as other factors, like a new software update, could also have increased productivity.
Which of the following is the BEST experimental design for measuring a causal effect?
Show the guide's explanation
Answer: A pharmaceutical company comparing a new drug's effect on a patient group against a placebo group.
The placebo-controlled trial is designed to isolate the drug's effect by creating a comparison group that is as identical as possible, thus approximating the counterfactual scenario. The other options describe correlations, which are likely influenced by confounding variables.
The 'fundamental problem of causal inference' refers to the fact that...
Show the guide's explanation
Answer: ...we can't observe the same person with and without a treatment at the same time.
This core problem states that we can only see one outcome for an individual—the one that actually happened. The counterfactual outcome (what would have happened otherwise) is forever unobservable, so we must use groups and statistical methods to estimate it.
Keep exploring
Find another idea for the decision in front of you.
The complete Reframo library is free to read. Explore another guide whenever you are ready.