Performance on the Cognitive Reflection Test is stable across time

Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 3

Abstract

A widely used measure of individual propensity to utilize analytic processing is the Cognitive Reflection Test (CRT), a set of math problems with intuitively compelling but incorrect answers. Here, we ask whether scores on this measure are temporally stable. We aggregate data from 11 studies run on Amazon Mechanical Turk in which the Cognitive Reflection Test (CRT) was administered and identify N = 3,302 unique individuals who completed the CRT two or more times. We find a strong correlation between an individual’s first and last CRT performance, r = .806. This remains true even when constraining to data points separated by over 2 years, r = .755. Furthermore, we find that CRT scores from one timepoint correlated negatively with belief in God and social conservatism from the other timepoint (and to a similar extent as scores gathered at the same timepoint). These results show that CRT scores are stable over time, and – given the stable relationship between CRT and religious belief and ideology – provide some evidence for the stability of analytic cognitive style more generally.

Authors and Affiliations

Michael N. Stagnaro, Gordon Pennycook and David G. Rand

Keywords

Related Articles

Amos Tversky's contributions to legal scholarship: Remarks at the BDRM session in honor of Amos Tversky, June 16, 2006

Together with his long-time colleague Daniel Kahneman, Amos Tversky, provided the intellectual infrastructure for contemporary behavioral law and economics. Prospect theory undermines the Coase Theorem, which is the bedr...

Now you see it now you don't: The effectiveness of the recognition heuristic for selecting stocks.

It has been proposed that recognition can form the basis of simple but ecologically rational decision strategies (Gigerenzer & Goldstein, 1996). Borges, Goldstein, Ortmann, & Gigerenzer (1999) found that constructing sha...

Physiological arousal in processing recognition information: Ignoring or integrating cognitive cues?

The recognition heuristic (RH; Goldstein & Gigerenzer, 2002) suggests that, when applicable, probabilistic inferences are based on a noncompensatory examination of whether an object is recognized or not. The overall find...

Cultural differences in risk: The group facilitation effect

We compared South Koreans with Australians in order to characterize cultural differences in attitudes and choices regarding risk, at both the individual and group levels. Our results showed that Australians, when assesse...

Is loss-aversion magnitude-dependent? Measuring prospective affective judgments regarding gains and losses

Prospect Theory proposed that the (dis)utility of losses is always more than gains due to a phenomena called ‘loss-aversion’, a result obtained in multiple later studies over the years. However, some researchers found re...

Download PDF file
  • EP ID EP678342
  • DOI -
  • Views 171
  • Downloads 0

How To Cite

Michael N. Stagnaro, Gordon Pennycook and David G. Rand (2018). Performance on the Cognitive Reflection Test is stable across time. Judgment and Decision Making, 13(3), -. https://europub.co.uk/articles/-A-678342