Mental model
Superforecasting Principles
A set of empirically tested cognitive habits that distinguish elite predictors from ordinary experts, focusing on how they think, not what they think.
Discover
Which trait do you think is most crucial for making consistently accurate predictions about the future?
Select the key characteristic of 'superforecasters':
Let's explore what the research says about making better predictions.
Understand
Understand
Superforecasting is a set of learnable habits for making more accurate predictions. Research shows the most crucial trait isn't deep expertise but active open-mindedness — the willingness to constantly seek out new evidence and update your beliefs. It replaces gut feelings with a structured, evidence-based process, improving decisions in areas from business strategy to personal finance. For example, a project manager, instead of just declaring a launch will succeed, breaks the problem down, seeks out disconfirming data from sales, and revises their forecast from 90% to 60% confidence based on new market research.
Ask this: "What new information would cause me to change my mind about this prediction?"
Full explanation
Full explanation
Superforecasting is not a magical ability but a disciplined, systematic process for thinking about the future. It emphasizes expressing forecasts in precise probabilities (e.g., "a 70% chance") rather than vague words like "probably." This forces clarity and makes it easier to track accuracy over time.
Several core principles emerged from studies of elite forecasters:
-
Find the "Outside View": Before focusing on the specifics of a situation, start with the base rate. To predict if a startup will succeed, don't start with their brilliant pitch deck; start with the fact that the majority of startups fail within their first few years.
-
Update Frequently: Treat your beliefs as temporary hypotheses. Superforecasters make small, frequent adjustments to their predictions as new information arrives, rather than waiting for a dramatic event. They are skilled at separating signal from noise.
-
Synthesize Diverse Views: Actively seek out perspectives that challenge your own. An investment analyst applying this principle wouldn't just read their own firm's reports; they would study the arguments of the most respected critics of their position to find flaws in their own reasoning.
This approach is most effective for questions with a specific, measurable outcome and a clear timeframe (e.g., "Will inflation in the UK be below 3% by the end of the year?"). It helps guard against common cognitive biases like overconfidence and confirmation bias, leading to better-calibrated judgments.
Research
Research
The principles of superforecasting were empirically identified by the Good Judgment Project (GJP), a large-scale forecasting tournament sponsored by the U.S. intelligence community. Researchers Philip Tetlock and Barbara Mellers discovered that a small percentage of volunteer forecasters were consistently more accurate than professional intelligence analysts with access to classified data. Their success was attributed not to who they were, but to how they thought—their cognitive style and methods.
- Tetlock & Gardner (2015): Superforecasters are defined by their cognitive style, including active open-mindedness, grit, and a growth mindset, which are more important than domain-specific expertise or raw intelligence. [1]
- Mellers et al. (2014): Gains came from both individual habits and powerful aggregation methods. Light training in probabilistic reasoning improved accuracy, but aggregating forecasts—especially when weighting more historically accurate forecasters—boosted prediction accuracy by over 20% compared to simple averages, demonstrating a synergy between individual skill and collective intelligence. [2]
- Tetlock (2005): In his earlier work, Expert Political Judgment, Tetlock found that the average expert was often no more accurate than chance, and that deep specialists were frequently less accurate than generalists due to overconfidence and ideological bias. [3]
Limitations
Limitations
Superforecasting is most effective for predicting events on a timescale from several weeks up to approximately 1-2 years, with clearly defined resolution criteria; performance typically declines as the time horizon grows. It is not designed for predicting long-term, complex systemic changes or unprecedented "black swan" events. The principles also require significant cognitive effort, discipline, and a willingness to engage with ambiguity, which can be difficult to maintain without structured practice and feedback.
Try it
Synthesize
Choose a pattern from the guide, then pick an action to try with it.
Which pattern stands out?
What will you try?
Choose a pattern above to select an action.
Sources
Sources
- [1] Superforecasting: The Art and Science of PredictionPhilip E. Tetlock & Dan Gardner - 2015
- [2] Psychological strategies for winning a geopolitical forecasting tournamentBarbara Mellers, Eric Stone, Terry Murray, et al. - 2014
- [3] Expert Political Judgment: How Good Is It? How Can We Know?Philip E. Tetlock - 2005
- [4] The Good Judgment ProjectThe Good Judgment Project - 2024
Try it
Check your understanding
A manager is trying to predict if a key project will finish on time. Which action best applies the superforecasting principle of 'finding the outside view'?
Show the guide's explanation
Answer: Reviewing the historical completion rates of similar projects in the company.
The 'outside view' or base rate involves looking at what happened in similar past situations. Historical completion rates provide an objective starting point, unlike personal confidence or best-case scenarios which are prone to optimism bias.
You forecast that your favorite team has an 80% chance of winning their next game. New information reveals their star player is injured. According to superforecasting principles, what should you do?
Show the guide's explanation
Answer: Lower your probability estimate to reflect the new data.
A core principle of superforecasting is to update your beliefs frequently in response to new evidence. The injury is significant new information that should cause you to revise your probabilistic forecast.
Based on the research from the Good Judgment Project, which statement about superforecasters is most accurate?
Show the guide's explanation
Answer: They are defined by a willingness to change their minds and learn from errors.
Research found that the key differentiator for superforecasters was their cognitive style—particularly active open-mindedness and a commitment to updating beliefs—not domain expertise or access to special information.
Keep exploring
Find another idea for the decision in front of you.
The complete Reframo library is free to read. Explore another guide whenever you are ready.