Mental model
Backdoor Criterion
A rule for identifying which variables to control for when estimating cause-and-effect relationships from observational data, helping us separate genuine causal effects from misleading correlations.
Discover
When scientists study whether something causes something else, they must decide which background factors to account for. Get this order wrong, and your conclusion flips: ice cream sales appear to cause drowning, unless you properly adjust for summer heat.
Which step comes first?
Learn the systematic way to pick the right controls.
Understand
Understand
The backdoor criterion is a checklist for deciding which factors to control for when trying to figure out whether one thing causes another. It tells you to block the "sneaky paths" that create spurious correlations—like how ice cream sales and drowning rates both rise in summer not because ice cream causes drowning, but because hot weather drives both. The criterion works by identifying variables that create backdoor paths from cause to effect and conditioning on them to block those paths while leaving the true causal path untouched. It prevents you from accidentally controlling for variables that would introduce new bias or that lie on the causal pathway you want to measure. To use it, first map out your cause, your effect, and the other factors that might connect them, then selectively block the confounding paths without disturbing the main causal road. Try this: When you hear about a surprising correlation, ask what hidden factor might be driving both.
Full explanation
Full explanation
How the Backdoor Criterion Works
The backdoor criterion provides a systematic way to choose control variables. You start by drawing your causal diagram: circles for variables, arrows for direct causal links. The "backdoor path" is any indirect route from cause to effect that starts with an arrow pointing into the cause (like a common ancestor affecting both). The criterion says: find variables that, when you condition on them, block every backdoor path without opening new ones or blocking the causal path you want to measure.
The Three Requirements
First, no variable you control for can be a descendant of your treatment. Controlling for a mediator blocks the very effect you're trying to measure. Second, your control set must block all backdoor paths between treatment and outcome. Third, controlling for your chosen variables should not create new spurious associations through colliders—variables with two arrows pointing into them that become biased when you condition on them.
Everyday Applications
In medicine, researchers studying whether coffee causes heart disease must control for smoking (which coffee drinkers are more likely to do) but not for cholesterol levels (which coffee might directly affect). In education, evaluating a teaching method requires adjusting for student background but not for test anxiety if the method itself changes anxiety levels. In business, assessing whether a marketing campaign boosts sales means controlling for seasonality but not for customer awareness if the campaign directly creates awareness.
Why It Matters
Without the backdoor criterion, researchers might control for too many variables (creating bias) or too few (leaving confounding). The framework turns an art into a science: instead of guessing which controls are "good," you follow a rigorous procedure. It also reveals counterintuitive cases where controlling for a pre-treatment variable actually makes your estimate worse—so-called "bad controls" that traditional statistics textbooks wrongly recommend adjusting for.
Research
Research
The backdoor criterion formalizes when causal effects can be identified from observational data by conditioning on appropriate variables. It provides sufficient conditions for selecting adjustment sets that yield unbiased estimates of causal effects in graphical causal models.
- Pearl (1995): Introduced the backdoor criterion as a graphical solution to the problem of confounding, establishing conditions under which adjustment for covariates yields valid causal effect estimates from non-experimental data [1].
- Cinelli, Forney, and Pearl (2020): Demonstrated through extensive examples how the backdoor criterion distinguishes "good controls" (reducing bias) from "bad controls" (amplifying bias or introducing new bias), revealing that traditional heuristics like "control for all pre-treatment variables" can be dangerously misleading [2].
- Shpitser, VanderWeele, and Robins (2011): Extended the backdoor criterion to settings with multiple treatments and outcomes, developing generalized adjustment criteria for complex causal structures including mediation analysis [3].
Limitations
Limitations
The backdoor criterion assumes you can correctly draw the causal diagram—including knowing which arrows exist and in which directions. In practice, this is often uncertain. It also requires that all confounders on backdoor paths be observed; if an important confounder is unmeasured, the criterion cannot rescue your estimate. The criterion does not address statistical efficiency—a variable might be "neutral" for bias but terrible for precision. It also assumes no interference between units (one person's treatment doesn't affect another's outcome) and no measurement error in the variables. When the true causal structure contains feedback loops or time-varying confounding, the basic backdoor criterion requires extension. Finally, the criterion tells you what can be adjusted for but not which adjustment method (matching, regression, weighting) works best in finite samples.
Try it
Synthesize
Choose a pattern from the guide, then pick an action to try with it.
Which pattern stands out?
What will you try?
Choose a pattern above to select an action.
Sources
Sources
- [1] Causal Diagrams for Empirical ResearchJudea Pearl - 1995
- [2] A Crash Course in Good and Bad ControlsCarlos Cinelli, Andrew Forney, and Judea Pearl - 2020
- [3] A Complete Graphical Criterion for the Adjustment Formula in Mediation AnalysisIlya Shpitser, Tyler J. VanderWeele, and James M. Robins - 2011
Try it
Check your understanding
A researcher studies whether a new training program improves worker productivity. Workers self-select into the program—more motivated workers are more likely to sign up. The researcher controls for worker motivation (measured before training) and also controls for worker satisfaction (measured after training). According to the backdoor criterion, which control is problematic?
Show the guide's explanation
Answer: Controlling for satisfaction is problematic—it's a post-treatment variable on the causal path
The backdoor criterion explicitly forbids controlling for descendants of the treatment. If the training program affects satisfaction, and satisfaction affects productivity, then controlling for satisfaction would block part of the very causal effect you're trying to measure. Pre-treatment motivation is a valid control because it's a common cause of both training participation and productivity, creating a backdoor path that should be blocked.
You're estimating the effect of education on income. Both are affected by family socioeconomic status (SES). Should you control for SES when estimating this causal effect?
Show the guide's explanation
Answer: Yes—SES is a common cause that creates a backdoor path
Family SES affects both education and income. This creates a backdoor path: Education ← SES → Income. The backdoor criterion tells us to condition on SES to block this spurious path. SES is not a mediator here because it's not caused by education—it's a pre-existing background factor. Controlling for it isolates the genuine effect of education on income.
Which of the following scenarios involves a backdoor path that needs to be blocked?
Show the guide's explanation
Answer: Ice cream consumption is correlated with drowning deaths—summer heat affects both
The ice cream-drowning relationship is a classic backdoor path scenario. The causal structure is: Ice cream ← Summer heat → Drowning. There's no direct arrow from ice cream to drowning, but they're correlated through the common cause (summer heat). The backdoor path goes "out the back door" of ice cream (arrow pointing INTO ice cream from heat) and into drowning. This spurious correlation would disappear if you properly control for temperature. The other options describe direct causal chains with no backdoor paths.
Keep exploring
Find another idea for the decision in front of you.
The complete Reframo library is free to read. Explore another guide whenever you are ready.