Investigating an alternate form of the cognitive reflection test
Journal Title: Judgment and Decision Making - Year 2016, Vol 11, Issue 1
Abstract
Much research in cognitive psychology has focused on the tendency to conserve limited cognitive resources. The CRT is the predominant measure of such miserly information processing, and also predicts a number of frequently studied decision-making traits (such as belief bias and need for cognition). However, many subjects from common subject populations have already been exposed to the questions, which might add considerable noise to data. Moreover, the CRT has been shown to be confounded with numeracy. To increase the pool of available questions and to try to address numeracy confounds, we developed and tested the CRT-2. CRT-2 questions appear to rely less on numeracy than the original CRT but appear to measure closely related constructs in other respects. Crucially, substantially fewer subjects from Amazon’s Mechanical Turk have been previously exposed to CRT-2 questions. Though our primary purpose was investigating the CRT-2, we also found that belief bias questions appear suitable as an additional source of new items. Implications and remaining measurement challenges are discussed.
Authors and Affiliations
Keela S. Thomson and Daniel M. Oppenheimer
Keywords
Related Articles
- EP ID EP678229
- DOI -
- Views 163
- Downloads 0
Different heuristics and same bias: A spectral analysis of biased judgments and individual decision rules
We used correlation and spectral analyses to investigate the cognitive structures and processes producing biased judgments. We used 5 different sets of driving problems to exemplify problems that trigger biases, specific...
Leftmost-digit-bias in an enumerated public sector? An experiment on citizens’ judgment of performance information
Numerical performance information is increasingly important to political decision-making in the public sector. Some have suggested that biases in citizens’ processing of numerical information can be exploited by politici...
How generalizable is good judgment? A multi-task, multi-benchmark study
Good judgment is often gauged against two gold standards – coherence and correspondence. Judgments are coherent if they demonstrate consistency with the axioms of probability theory or propositional logic. Judgments are...
Commitment-enhancing tools in Centipede games: Evidencing European–Japanese differences in trust and cooperation
Theories of trust distinguish general trust in situations of social uncertainty from assurance-based trust in committed, long-term relationships. This study investigates European-Japanese differences using the Centipede...
Semantic cross-scale numerical anchoring
Anchoring effects are robust, varied and can be consequential. Researchers have provided a variety of alternative explanations for these effects. More recently, it has become apparent that anchoring effects might be prod...