The category size bias: A mere misunderstanding
Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 2
Abstract
Redundant or excessive information can sometimes lead people to lean on it unnecessarily. Certain experimental designs can sometimes bias results in the researcher’s favor. And, sometimes, interesting effects are too small to be studied, practically, or are simply zero. We believe a confluence of these factors led to a recent paper (Isaac & Brough, 2014, JCR). This initial paper proposed a new means by which probability judgments can be led astray: the category size bias, by which an individual event coming from a large category is judged more likely to occur than an event coming from a small one. Our work shows that this effect may be due to instructional and mechanical confounds, rather than interesting psychology. We present eleven studies with over ten times the sample size of the original in support of our conclusion: We replicate three of the five original studies and reduce or eliminate the effect by resolving these methodological issues, even significantly reversing the bias in one case (Study 6). Studies 7–8c suggest the remaining two studies are false positives. We conclude with a discussion of the subtleties of instruction wording, the difficulties of correcting the record, and the importance of replication and open science.
Authors and Affiliations
Hannah Perfecto, Leif D. Nelson and Don A. Moore
Keywords
Related Articles
- EP ID EP678335
- DOI -
- Views 143
- Downloads 0
A Domain-Specific Risk-Taking (DOSPERT) scale for adult populations
This paper proposes a revised version of the original Domain-Specific Risk-Taking (DOSPERT) scale developed by Weber, Blais, and Betz (2002) that is shorter and applicable to a {broader range of ages, cultures, and educa...
A universal method for evaluating the quality of aggregators
We propose a new method to facilitate comparison of aggregated forecasts based on different aggregation, elicitation and calibration methods. Aggregates are evaluated by their relative position on the cumulative distribu...
Predicting soccer matches: A reassessment of the benefit of unconscious thinking
We evaluate Dijksterhuis, Bos, van der Leij, & van Baaren (2009), Psychological Science, on the benefit of unconscious thinking in predicting the outcomes of soccer matches. We conclude that the evidence that unconscious...
Reducing the impact bias in judgments of post-decisional affect: Distraction or task interference.?
People overestimate their affective reactions to future events and decisions — a phenomenon that has been termed “impact bias.” Evidence suggests that completing a diary detailing events contemporaneous with the focal on...
It’s personal: The effect of personal value on utilitarian moral judgments
We investigated whether the personal importance of objects influences utilitarian decision-making in which damaging property is necessary to produce an overall positive outcome. In Experiment 1, participants judged savin...