Are markets more accurate than polls? The surprising informational value of “just asking”
Journal Title: Judgment and Decision Making - Year 2019, Vol 14, Issue 2
Abstract
Psychologists typically measure beliefs and preferences using self-reports, whereas economists are much more likely to infer them from behavior. Prediction markets appear to be a victory for the economic approach, having yielded more accurate probability estimates than opinion polls or experts for a wide variety of events, all without ever asking for self-reported beliefs. We conduct the most direct comparison to date of prediction markets to simple self-reports using a within-subject design. Our participants traded on the likelihood of geopolitical events. Each time they placed a trade, they first had to report their belief that the event would occur on a 0–100 scale. When previously validated aggregation algorithms were applied to self-reported beliefs, they were at least as accurate as prediction-market prices in predicting a wide range of geopolitical events. Furthermore, the combination of approaches was significantly more accurate than prediction-market prices alone, indicating that self-reports contained information that the market did not efficiently aggregate. Combining measurement techniques across behavioral and social sciences may have greater benefits than previously thought.
Authors and Affiliations
Jason Dana, Pavel Atanasov, Philip Tetlock and Barbara Mellers
Keywords
Related Articles
- EP ID EP678405
- DOI -
- Views 156
- Downloads 0
Emerging sacred values: Iran’s nuclear program
Sacred values are different from secular values in that they are often associated with violations of the cost-benefit logic of rational choice models. Previous work on sacred values has been largely limited to religious...
A note on determining the number of cues used in judgment analysis studies: The issue of type II error
Many judgment analysis studies employ multiple regression procedures to estimate the importance of cues. Some studies test the significance of regression coefficients in order to decide whether or not specific cues are a...
The effects of attractive but unattainable alternatives on the attractiveness of near and distant future menus
We examine how adding an Attractive but Unattainable Alternative (AUA) to a set of available but less attractive alternatives influences evaluations of near vs. distant future sets of alternatives. According to Construal...
Boosting intelligence analysts’ judgment accuracy: What works, what fails?
A routine part of intelligence analysis is judging the probability of alternative hypotheses given available evidence. Intelligence organizations advise analysts to use intelligence-tradecraft methods such as Analysis of...
Image Theory’s counting rule in clinical decision making: Does it describe how clinicians make patient-specific forecasts?
The field of clinical decision making is polarized by two predominate views. One holds that treatment recommendations should conform with guidelines; the other emphasizes clinical expertise in reaching case-specific judg...