Developing expert political judgment: The impact of training and practice on judgmental accuracy in geopolitical forecasting tournaments
Journal Title: Judgment and Decision Making - Year 2016, Vol 11, Issue 5
Abstract
The heuristics-and-biases research program highlights reasons for expecting people to be poor intuitive forecasters. This article tests the power of a cognitive-debiasing training module (“CHAMPS KNOW”) to improve probability judgments in a four-year series of geopolitical forecasting tournaments sponsored by the U.S. intelligence community. Although the training lasted less than one hour, it consistently improved accuracy (Brier scores) by 6 to 11% over the control condition. Cognitive ability and practice also made largely independent contributions to predictive accuracy. Given the brevity of the training tutorials and the heterogeneity of the problems posed, the observed effects are likely to be lower-bound estimates of what could be achieved by more intensive interventions. Future work should isolate which prongs of the multipronged CHAMPS KNOW training were most effective in improving judgment on which categories of problems.
Authors and Affiliations
Welton Chang, Eva Chen, Barbara Mellers and Philip Tetlock
Keywords
Related Articles
- EP ID EP678263
- DOI -
- Views 145
- Downloads 0
Numerate decision makers don’t use more effortful strategies unless it pays: A process tracing investigation of skilled and adaptive strategy selection in risky decision making
The present study investigated skilled and adaptive strategy selection in risky decision making. We proposed that people with high objective numeracy, a strong predictor of general decision making skill, would have a bro...
Gender Differences in Risk Assessment: Why do Women Take Fewer Risks than Men?
Across many real-world domains, men engage in more risky behaviors than do women. To examine some of the beliefs and preferences that underlie this difference, 657 participants assessed their likelihood of engaging in va...
The empirical content of theories in judgment and decision making: Shortcomings and remedies
According to Karl Popper, we can tell good theories from poor ones by assessing their empirical content (empirischer Gehalt), which basically reflects how much information they convey concerning the world. “The empirical...
Maximizing as a predictor of job satisfaction and performance: A tale of three scales
Research on individual differences in maximizing (versus satisficing) has recently proliferated in the Judgment and Decision Making literature, and high scores on this construct have been linked to lower life satisfactio...
The role of character strengths in economic decision-making
We aggregated data from 28 studies (total N=13,386) to assess the relationship between individual differences in character strengths, as described by the VIA model of character, and economically-relevant behaviors and co...