Mental model
Weighted Averaging
A method for combining judgments that gives more influence to more reliable or knowledgeable sources, improving accuracy over simple averaging.
Discover
Your team needs to estimate a project's completion time. The senior developer says 3 weeks, the junior developer says 6 weeks, and the product manager says 2 weeks. If you simply average these estimates (3.7 weeks), you might be missing something important.
How should you combine these estimates?
Learn how performance-based weighting can improve group decisions.
Understand
Understand
Weighted averaging combines multiple opinions or predictions by giving more influence to sources that have proven more reliable in the past. Instead of treating everyone's input equally, you assign higher weights to experts with better track records. For example, when combining predictions, you might give proportionally higher weight to sources with demonstrated better accuracy, while lower-performing sources receive proportionally less influence. Try this: When combining opinions from people with different expertise levels, ask yourself whose past judgments have been most accurate.
Full explanation
Full explanation
Weighted averaging works through a sequential process: first, track each person's or model's performance on similar predictions over time; second, assign weights proportional to that performance (higher accuracy gets higher weight); third, multiply each estimate by its weight and sum the results. The key insight is that not all opinions are equally valuable, and past performance is often the best predictor of future accuracy.
This approach appears everywhere. In financial forecasting, veteran analysts whose predictions beat the market consistently get more influence in portfolio decisions. In meteorology, ensemble prediction systems combine multiple forecasts, and research has examined whether weighting models by past performance improves accuracy. The Classical Model of expert judgment validates expertise through performance calibration, potentially giving more influence to better-calibrated experts. The mechanism ensures that information from the most reliable sources shapes the final decision most strongly.
However, weighted averaging works best when you have objective measures of past performance, when experts are making predictions within their domain of expertise, and when sources don't all share the same biases or blind spots. If everyone relies on the same flawed information, even performance-weighted aggregation won't catch systematic errors. The approach improves upon simple averaging but doesn't eliminate the need for diverse perspectives and independent judgment.
Research
Research
- Weighting schemes that adapt to changing performance patterns help maintain accuracy over time, while static weights can degrade as forecasters' performance evolves or environmental conditions shift [2]
Limitations
Limitations
Weighted averaging breaks down when performance measures are unreliable, when experts' past success won't repeat in the current context, or when diversity of perspectives is more important than individual accuracy. The approach can amplify overconfidence if high weights go to strongly opinionated but wrong experts, and it may suppress valuable contrarian views from less-established sources. Complex environments where the relationship between past and future performance is unstable pose particular challenges for performance-based weighting schemes.
Try it
Synthesize
Choose a pattern from the guide, then pick an action to try with it.
Which pattern stands out?
What will you try?
Choose a pattern above to select an action.
Sources
Sources
- [1] Identifying Expertise to Extract the Wisdom of CrowdsDavid V. Budescu and Eva Chen - 2015
- [2] Validating Expert Judgment with the Classical ModelRoger M. Cooke - 2014
Try it
Check your understanding
A medical team is diagnosing a rare condition. Dr. Smith (an infectious disease specialist who has been correct on 90% of similar cases) says it's Condition A. Dr. Jones (a general practitioner with 70% overall diagnostic accuracy) says it's Condition B. Dr. Chen (a radiologist who has correctly identified this condition 85% of the time) says it's Condition A. What does performance-weighted aggregation suggest?
Show the guide's explanation
Answer: Weight toward Condition A due to specialist accuracy
Performance-weighted aggregation gives more influence to experts with better track records in the relevant domain. Both the specialist (90%) and radiologist (85%) who correctly identified this condition before support Condition A, so their combined weighted judgment should dominate the general practitioner's view. This demonstrates how weighted averaging improves on simple majority or equal-weighting approaches.
Your team combines sales forecasts from three analysts. Using performance-weighted averaging, you assign weights of 50%, 30%, and 20%. After a quarter, you discover that the analyst receiving 20% weight was actually most accurate. What should you do next?
Show the guide's explanation
Answer: Recalibrate weights based on updated performance data
Weighted averaging is an iterative process: as new performance data arrives, weights should be updated to reflect current accuracy. This doesn't mean abandoning the approach—it means refining it. The mechanism requires ongoing calibration to remain effective, which is why having sufficient historical data is crucial for reliable weighted aggregation.
Which scenario poses the greatest risk to the effectiveness of performance-weighted aggregation?
Show the guide's explanation
Answer: Investment analysts predicting a completely new type of financial instrument
Performance-weighted aggregation depends on the assumption that past performance predicts future accuracy. When experts face fundamentally new problems where their historical track record may not apply—a novel financial instrument, unprecedented crisis, or technological paradigm shift—the weights may no longer reflect actual expertise. This is a key limitation: the method works best when experts are operating within familiar domains where their past success is relevant to current predictions.
Keep exploring
Find another idea for the decision in front of you.
The complete Reframo library is free to read. Explore another guide whenever you are ready.