Mental model
Noncompliance and Intent-to-Treat
When participants switch treatments or drop out, special analysis methods like Intent-to-Treat and Instrumental Variables help recover the true causal effect.
Discover
A clinical trial tests a new diet program. Half of participants assigned to the diet never follow it, while some in the control group start dieting on their own. What happens if you just compare people who actually dieted vs. those who didn't?
Choose the best answer
See how researchers handle this problem
Understand
Understand
When people don't follow their assigned treatment in a study, simply comparing those who did vs. didn't can give misleading results. Think of it like a restaurant review: if you only rate the dishes customers actually ordered (instead of what the chef recommended), you might miss whether the chef's recommendations were actually good. Intent-to-Treat analysis preserves randomization by keeping people in their original groups, while Instrumental Variables and LATE help estimate effects for the subset of people who would comply with treatment. Check this: Always ask whether a study reports results by assignment or by actual treatment received.
Full explanation
Full explanation
The Core Problem
Noncompliance breaks the magic of randomization. When participants cross over between groups, the groups become different in ways that can distort results. People who choose to follow a treatment may be healthier, wealthier, or more motivated than those who don't—and those differences, not the treatment itself, might explain better outcomes.
Intent-to-Treat (ITT)
Intent-to-Treat analysis keeps everyone in their original assigned group, regardless of what they actually did. This preserves randomization and gives an unbiased estimate of the effect of being offered treatment. For example, in a study of a new medication, ITT compares everyone assigned to receive the drug against everyone assigned to placebo, even if some people never took their pills. ITT answers the policy-relevant question: "What happens if we offer this treatment broadly?"
The Limitations of ITT
However, ITT mixes two effects: the effect of the treatment itself and the effect of people actually using it. If 80% of participants don't follow the treatment, ITT might show no effect even if the treatment works miracles for those who use it. This is where Instrumental Variables (IV) and Local Average Treatment Effect (LATE) come in.
Instrumental Variables and LATE
Instrumental Variables analysis uses random assignment as a "natural instrument" to isolate causal effects. Random assignment affects treatment uptake but doesn't directly affect outcomes (except through treatment). This lets researchers estimate the effect for compliers—people who would follow treatment if assigned to it but wouldn't otherwise. This is the LATE: the effect for the subpopulation whose treatment status is actually changed by assignment.
Real-World Applications
In education policy, a lottery for charter school admission is an instrument. ITT compares lottery winners vs. losers, answering whether the lottery system improves outcomes overall. IV/LATE estimates the effect for students who would attend charter schools if given the chance but wouldn't otherwise. In medicine, a randomized encouragement to exercise is an instrument for actual exercise behavior, separating the motivational effect of the invitation from the physiological effect of exercise itself.
Research
Research
Noncompliance poses a fundamental challenge to causal inference because it severs the link between random assignment and actual treatment received. The Intent-to-Treat principle preserves the validity of randomization by analyzing participants according to their original assignment, producing unbiased estimates of the effect of treatment offer rather than treatment receipt [1]. When noncompliance is substantial, Instrumental Variables analysis leverages random assignment as an instrument, using the exclusion restriction (assignment affects outcomes only through treatment receipt) and monotonicity (no defiers) assumptions to identify the Local Average Treatment Effect for compliers [2].
- Angrist, Imbens, and Rubin (1996) formalized the LATE framework, showing that IV identifies the average treatment effect for compliers—those who take treatment when assigned to it but not otherwise—under clear assumptions [3].
- Imbens and Rubin (2015) demonstrated that LATE provides more policy-relevant estimates than per-protocol analyses when heterogeneity exists across subpopulations with different compliance behaviors [4].
- Hernán and Robins (2020) caution that ITT effects may be diluted by poor adherence, potentially leading to erroneous conclusions about treatment efficacy when combined with naive non-inferiority margins [5].
Gloss: Compliers are participants who would take the treatment if assigned to receive it but would not if assigned to control. Exclusion restriction means assignment affects outcomes only through its effect on treatment receipt, not through other pathways. Monotonicity assumes there are no "defiers" who would do the opposite of their assignment.
Limitations
Limitations
LATE has important limitations. It identifies effects only for compliers, not the entire population—and compliers may be a small or unrepresentative subgroup. If compliers differ systematically from the full population, LATE may not generalize well. The exclusion restriction can be violated if assignment affects outcomes through other channels (e.g., psychological effects of knowing you were "chosen" for treatment). Instrument strength matters too: weak instruments (where assignment barely affects treatment uptake) produce biased estimates. Some situations involve "defiers" (people who do the opposite of their assignment), violating monotonicity, though this is rare in practice. Finally, IV methods cannot estimate effects for "never-takers" or "always-takers"—their treatment status doesn't vary with assignment.
Try it
Synthesize
Choose a pattern from the guide, then pick an action to try with it.
Which pattern stands out?
What will you try?
Choose a pattern above to select an action.
Sources
Sources
- [1] Causal Inference for Statistics, Social, and Biomedical Sciences: An IntroductionGuido W. Imbens and Donald B. Rubin - 2015
- [2] Identification of Causal Effects Using Instrumental VariablesJoshua D. Angrist, Guido W. Imbens, and Donald B. Rubin - 1996
- [3] Causal Inference: What IfMiguel A. Hernán and James M. Robins - 2020
- [4] Instrumental Variables: An Econometrician's PerspectiveGuido W. Imbens - 2014
- [5] Instrumental Variables Regression in Stata, R, and SPSSRichard Williams - 2020
Try it
Check your understanding
A study randomly assigns 100 patients to receive a new drug and 100 to placebo. In the drug group, only 60 patients actually take the medication. In the placebo group, 20 patients manage to obtain the drug on their own. What does an Intent-to-Treat analysis compare?
Show the guide's explanation
Answer: 100 assigned to drug vs. 100 assigned to placebo
Intent-to-Treat keeps everyone in their original assigned group regardless of actual treatment received. This preserves randomization and compares the 100 originally assigned to the drug against the 100 originally assigned to placebo, even though some crossed over. ITT estimates the effect of being *offered* treatment, not the effect of actually receiving it.
A university uses a lottery for scholarship eligibility. Researchers want to estimate the effect of receiving the scholarship on graduation rates. The lottery is random, but only 60% of winners actually accept and use the scholarship, while 10% of non-winners find other funding. What does LATE estimate in this context?
Show the guide's explanation
Answer: Effect of the scholarship for those who would use it if they won the lottery
LATE (Local Average Treatment Effect) estimates the causal effect specifically for compliers—those whose treatment status is actually changed by the instrument (the lottery). These are students who would accept and use the scholarship if they won the lottery, but would not receive equivalent scholarships if they lost. LATE does not estimate effects for always-takers (who'd get scholarships regardless) or never-takers (who wouldn't use them even if offered).
Why can't we simply compare participants who actually followed their assigned treatment against those who didn't?
Show the guide's explanation
Answer: Randomization is broken and groups become systematically different
When we compare by actual treatment received rather than assigned treatment, we lose the benefits of randomization. People who comply with treatment may differ in systematic ways from those who don't—they might be healthier, more motivated, wealthier, or have better social support. These pre-existing differences, not the treatment itself, could explain better outcomes. This is selection bias masquerading as a treatment effect. ITT preserves randomization; IV methods recover causal effects under specific assumptions about how compliance relates to outcomes.
Keep exploring
Find another idea for the decision in front of you.
The complete Reframo library is free to read. Explore another guide whenever you are ready.