Mental model
Group vs. Individual Fairness
Two competing approaches to measuring fairness in AI systems: ensuring similar outcomes across demographic groups versus treating similar individuals equally regardless of group identity.
Discover
A bank's loan approval system needs to be audited for fairness. One approach ensures equal approval rates across neighborhoods, while another ensures similar credit scores get similar decisions regardless of where someone lives. Both claim to be 'fair'—but they pull in opposite directions.
Which fairness goal matters more?
Understanding this tension reveals why 'fair AI' is harder than it seems.
Understand
Understand
Group fairness asks whether different populations (like neighborhoods, ethnic groups, or genders) get similar outcomes overall—for instance, whether loan approval rates are roughly equal across communities. Individual fairness asks whether people who are similar in relevant ways get treated the same way, regardless of which group they belong to.
Full explanation
Full explanation
Group fairness measures statistical parity across populations—comparing approval rates, prediction scores, or hiring rates between demographic groups. The core intuition is that if a system works fairly, no protected group should systematically receive worse outcomes. Individual fairness, by contrast, focuses on consistency: people with similar qualifications or circumstances should receive similar decisions, regardless of their demographic identity.
The tension arises because these principles can't be simultaneously maximized. If one group genuinely has higher average qualifications (due to education, experience, or other factors), forcing equal approval rates means either rejecting qualified candidates from the higher-scoring group or lowering standards for the lower-scoring group. Conversely, applying identical decision rules to every individual often produces different group outcomes if the groups differ on relevant factors.
This tradeoff appears everywhere. In hiring, group fairness pushes for diverse representation, while individual fairness insists that the best-qualified candidate gets the job regardless of demographics. In lending, group fairness flags redlining patterns, while individual fairness requires that creditworthy applicants get approved regardless of neighborhood. In healthcare, group fairness audits whether treatment recommendations vary by race, while individual fairness ensures that patients with identical symptoms and history receive identical care. The best approach depends on context: group fairness excels at detecting systemic bias, while individual fairness protects meritocracy and prevents reverse discrimination.
Research
Research
Fairness in machine learning requires contextual value judgments about which principles matter most for specific applications. Different fairness criteria often involve trade-offs rather than pure technical optimization.
Limitations
Limitations
The framework tends to treat group membership as fixed and observable, missing intersectional considerations (how race, gender, and class interact) and situations where group identity is sensitive, self-identified, or fluid. Finally, formal fairness definitions focus on statistical properties at the expense of procedural fairness—whether the decision-making process itself is transparent, contestable, and perceived as legitimate by affected communities.
Try it
Synthesize
Choose a pattern from the guide, then pick an action to try with it.
Which pattern stands out?
What will you try?
Choose a pattern above to select an action.
Sources
Sources
- [1] Fairness and Machine Learning: Limitations and OpportunitiesSolon Barocas, Moritz Hardt, and Arvind Narayanan - 2019
Try it
Check your understanding
A university uses an AI to review applications. They discover that achieving equal admission rates across neighborhoods would require rejecting some highly-qualified students from certain areas while admitting less-qualified students from others. What tradeoff does this reveal?
Show the guide's explanation
Answer: Group fairness and individual fairness can conflict
This scenario demonstrates the core tension: forcing equal group outcomes means treating individuals with different qualifications differently, violating individual fairness.
Which fairness approach would better detect that a credit scoring system denies loans to qualified applicants simply because they live in a specific zip code?
Show the guide's explanation
Answer: Group fairness
Group fairness compares outcomes across populations (like zip codes) and would flag systematic disparities in approval rates. Individual fairness examines whether similar individuals receive similar treatment, but redlining operates at the group level—rejecting entire areas regardless of individual qualifications. Group-level audits catch patterns that individual case-by-case analysis misses.
Two candidates with identical test scores, experience, and interview performance apply for a job. One gets hired while the other doesn't. A fairness audit finds the only meaningful difference is their gender. Which fairness principle is violated?
Show the guide's explanation
Answer: Individual fairness
Individual fairness requires that similar individuals receive similar treatment. Since these candidates are identical on all relevant dimensions, fairness demands identical decisions. The demographic difference should not affect the outcome. Group fairness would only look at overall hiring statistics by gender, but this violation is about treating comparable individuals unequally—a direct individual fairness violation.
Keep exploring
Find another idea for the decision in front of you.
The complete Reframo library is free to read. Explore another guide whenever you are ready.