Performance on the Cognitive Reflection Test is stable across time
Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 3
Abstract
A widely used measure of individual propensity to utilize analytic processing is the Cognitive Reflection Test (CRT), a set of math problems with intuitively compelling but incorrect answers. Here, we ask whether scores on this measure are temporally stable. We aggregate data from 11 studies run on Amazon Mechanical Turk in which the Cognitive Reflection Test (CRT) was administered and identify N = 3,302 unique individuals who completed the CRT two or more times. We find a strong correlation between an individual’s first and last CRT performance, r = .806. This remains true even when constraining to data points separated by over 2 years, r = .755. Furthermore, we find that CRT scores from one timepoint correlated negatively with belief in God and social conservatism from the other timepoint (and to a similar extent as scores gathered at the same timepoint). These results show that CRT scores are stable over time, and – given the stable relationship between CRT and religious belief and ideology – provide some evidence for the stability of analytic cognitive style more generally.
Authors and Affiliations
Michael N. Stagnaro, Gordon Pennycook and David G. Rand
Keywords
Related Articles
- EP ID EP678342
- DOI -
- Views 166
- Downloads 0
On the role of recognition in consumer choice: A model comparison
One prominent model in the realm of memory-based judgments and decisions is the recognition heuristic. Under certain preconditions, it presumes that choices are based on recognition in a one-cue non-compensatory manner a...
Evaluating the coherence of Take-the-best in structured environments
Heuristic decision-making models, like Take-the-best, rely on environmental regularities. They conduct a limited search, and ignore available information, by assuming there is structure in the decision-making environment...
Reversing the causal arrow: Incidence and properties of negative backward magical contagion in Americans
Backward magical contagion describes instances in which individuals (sources) express discomfort or pleasure when something connected to them (medium; e.g., hair, a diary) falls into the possession of a negatively- or po...
Naturalness judgments by lay Americans: Process dominates content in judgments of food or water acceptability and naturalness
This study directly tests the hypothesis that, at least within the domains of food and drink for Americans, the judgment of naturalness has more to do with the history of an object, that is the processes that it has unde...
Lay attitudes to trade with low-wage countries
Three studies presented scenarios to lay people to investigate their willingness to restrict imports. Greater restriction was preferred when similar goods were made at home, when the owners of the foreign businesses made...