Performance on the Cognitive Reflection Test is stable across time
Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 3
Abstract
A widely used measure of individual propensity to utilize analytic processing is the Cognitive Reflection Test (CRT), a set of math problems with intuitively compelling but incorrect answers. Here, we ask whether scores on this measure are temporally stable. We aggregate data from 11 studies run on Amazon Mechanical Turk in which the Cognitive Reflection Test (CRT) was administered and identify N = 3,302 unique individuals who completed the CRT two or more times. We find a strong correlation between an individual’s first and last CRT performance, r = .806. This remains true even when constraining to data points separated by over 2 years, r = .755. Furthermore, we find that CRT scores from one timepoint correlated negatively with belief in God and social conservatism from the other timepoint (and to a similar extent as scores gathered at the same timepoint). These results show that CRT scores are stable over time, and – given the stable relationship between CRT and religious belief and ideology – provide some evidence for the stability of analytic cognitive style more generally.
Authors and Affiliations
Michael N. Stagnaro, Gordon Pennycook and David G. Rand
Keywords
Related Articles
- EP ID EP678342
- DOI -
- Views 151
- Downloads 0
Framing the frame: How task goals determine the likelihood and direction of framing effects
We examined how the goal of a decision task influences the perceived positive, negative valence of the alternatives and thereby the likelihood and direction of framing effects. In Study 1 we manipulated the goal to incre...
Response time and decision making: An experimental study
Response time is used here to interpret choice in decision problems. I first establish that there is a close connection between short response time and choices that are clearly a mistake. I then investigate whether a cor...
Graphs versus numbers: How information format affects risk aversion in gambling
In lottery gambling, the common phenomenon of risk aversion shows up as preference of the option with the higher win probability, even if a riskier alternative offers a greater expected value. Because riskier choices wou...
“Am I going to be happy and financially stable?”: How American women feel when they think about financial security
Before the recent recession evoked general dismay and uncertainty, this study examined the relative contribution of income and the concern over financial security to life satisfaction. The degree to which such concerns p...
The narrative bias revisited: What drives the biasing influence of narrative information on risk perceptions?
When people judge risk or the probability of a risky prospect, single case narratives can bias judgments when a statistical base-rate is also provided. In this work we investigate various methodological and procedural fa...