The category size bias: A mere misunderstanding
Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 2
Abstract
Redundant or excessive information can sometimes lead people to lean on it unnecessarily. Certain experimental designs can sometimes bias results in the researcher’s favor. And, sometimes, interesting effects are too small to be studied, practically, or are simply zero. We believe a confluence of these factors led to a recent paper (Isaac & Brough, 2014, JCR). This initial paper proposed a new means by which probability judgments can be led astray: the category size bias, by which an individual event coming from a large category is judged more likely to occur than an event coming from a small one. Our work shows that this effect may be due to instructional and mechanical confounds, rather than interesting psychology. We present eleven studies with over ten times the sample size of the original in support of our conclusion: We replicate three of the five original studies and reduce or eliminate the effect by resolving these methodological issues, even significantly reversing the bias in one case (Study 6). Studies 7–8c suggest the remaining two studies are false positives. We conclude with a discussion of the subtleties of instruction wording, the difficulties of correcting the record, and the importance of replication and open science.
Authors and Affiliations
Hannah Perfecto, Leif D. Nelson and Don A. Moore
Keywords
Related Articles
- EP ID EP678335
- DOI -
- Views 164
- Downloads 0
Success-slope effects on the illusion of control and on remembered success-frequency
The illusion of control refers to the inference of action-outcome contingency in situations where outcomes are in fact random. The strength of this illusion has been found to be affected by whether the frequency of succe...
“Lean not on your own understanding”: Belief that morality is founded on divine authority and non-utilitarian moral judgments
Recent research has shown that religious individuals are much more resistant to utilitarian modes of thinking than their less religious counterparts, but the reason for this is not clear. We propose that a meta-ethical b...
The Decision Making Individual Differences Inventory and guidelines for the study of individual differences in judgment and decision-making research
Individual differences in decision making are a topic of longstanding interest, but often yield inconsistent and contradictory results. After providing an overview of individual difference measures that have commonly bee...
In defense of the personal/impersonal distinction in moral psychology research: Cross-cultural validation of the dual process model of moral judgment
The dual process model of moral judgment (DPM; Greene et al., 2004) argues that such judgments are influenced by both emotion-laden intuition and controlled reasoning. These influences are associated with distinct neural...
When being wasteful appears better than feeling wasteful
“Waste not want not” expresses our culture’s aversion to waste. “I could have gotten the same thing for less” is a sentiment that can diminish pleasure in a transaction. We study people’s willingness to “pay” to avoid th...