Galton's Ox Experiment

In a famous 1906 experiment by Sir Francis Galton, the average guess from 787 fairgoers for an ox's weight was 1,197 pounds—less than 1% off the true weight of 1,198 pounds. This demonstrated that a diverse crowd's collective judgment can be remarkably accurate because individual errors—some guessing too high, others too low—tend to cancel each other out.

For example, if you ask a large group to guess the number of jellybeans in a jar, the average of all their guesses will likely be closer to the true count than most individual attempts.

Ask this: When could I get a better answer by polling a group instead of asking one expert?

Galton's Ox experiment is the foundational example of the "wisdom of crowds." The core mechanism is statistical aggregation. While any single person's guess contains both information and error, the errors are often random. When you combine many independent guesses, these random errors tend to offset one another, leaving a collective judgment that is surprisingly close to the true value.

In Galton's study, both the mean (the simple average) and the median (the middle value) were highly accurate. Throughout this entry, 'average' refers to the mean unless otherwise specified.

For this effect to work, four conditions are crucial:

• Diversity: The group needs a mix of different perspectives and information.
• Independence: Individuals must form their opinions without being influenced by others.
• Decentralization: People should be able to draw on their own local, specific knowledge.
• Aggregation: A mechanism must exist to combine individual judgments into a collective decision.

This principle is applied in many modern contexts. Financial markets, in theory, aggregate the diverse opinions of millions of investors to determine asset prices. Companies use internal prediction markets, polling employees to forecast project deadlines or sales figures, often yielding more accurate results than traditional planning methods.

However, the wisdom of crowds is not a magic bullet. It fails when the crowd lacks diversity, when people start copying each other (leading to information cascades or groupthink), or when the problem requires specialized expertise. It works for guessing an ox's weight, but not for performing brain surgery.

The "wisdom of crowds" is the principle that aggregating independent judgments can produce highly accurate estimates, as the group's collective error is often smaller than the average individual's error. Its effectiveness depends on key conditions identified by subsequent research.

• Galton (1907): In the foundational experiment, the crowd's median guess for an ox's weight was 1,207 lbs and the mean was 1,197 lbs; the actual weight was 1,198 lbs, demonstrating remarkable collective accuracy. [1]
• Surowiecki (2004): Identified four critical conditions for a wise crowd: diversity of opinion, independence of members, decentralization of knowledge, and a mechanism for aggregation. [2]
• Larrick & Soll (2006): Demonstrated the power of this effect with the "averaging principle," showing that averaging even two independent guesses is typically more accurate than choosing the single best guess. [3]

The wisdom of crowds is not universal. Its primary limitation is the requirement for independent judgments. When individuals influence each other, errors can become correlated and amplified, leading to herd behavior, market bubbles, or groupthink. Furthermore, if the crowd as a whole shares a systematic bias (e.g., everyone is overly optimistic), the average will simply reflect that bias. The principle is also less effective for problems requiring deep, specialized expertise that cannot be broken down into smaller, independent judgments.