Performance on the Cognitive Reflection Test is stable across time
Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 3
Abstract
A widely used measure of individual propensity to utilize analytic processing is the Cognitive Reflection Test (CRT), a set of math problems with intuitively compelling but incorrect answers. Here, we ask whether scores on this measure are temporally stable. We aggregate data from 11 studies run on Amazon Mechanical Turk in which the Cognitive Reflection Test (CRT) was administered and identify N = 3,302 unique individuals who completed the CRT two or more times. We find a strong correlation between an individual’s first and last CRT performance, r = .806. This remains true even when constraining to data points separated by over 2 years, r = .755. Furthermore, we find that CRT scores from one timepoint correlated negatively with belief in God and social conservatism from the other timepoint (and to a similar extent as scores gathered at the same timepoint). These results show that CRT scores are stable over time, and – given the stable relationship between CRT and religious belief and ideology – provide some evidence for the stability of analytic cognitive style more generally.
Authors and Affiliations
Michael N. Stagnaro, Gordon Pennycook and David G. Rand
Keywords
Related Articles
- EP ID EP678342
- DOI -
- Views 170
- Downloads 0
Preference-driven biases in decision makers’ information search and evaluation
While it is well established that the search for information after a decision is biased toward supporting that decision, the case of preference-supporting search before the decision remains open. Three studies of consume...
Making good cider out of bad apples — Signaling expectations boosts cooperation among would-be free riders
The present study investigates how group-cooperation heuristics boost voluntary contributions in a repeated public goods game. We manipulate two separate factors in a two-person public goods game: i) group composition (S...
The empirical content of theories in judgment and decision making: Shortcomings and remedies
According to Karl Popper, we can tell good theories from poor ones by assessing their empirical content (empirischer Gehalt), which basically reflects how much information they convey concerning the world. “The empirical...
Comparative evaluation of the forecast accuracy of analysis reports and a prediction market
This paper summarizes an empirical comparison of the accuracy of forecasts included in analysis reports developed by professional intelligence analysts to comparable forecasts in a prediction market that has broad partic...
Decision making in civil disputes: The effects of legal role, frame, and perceived chance of winning
The present study investigates the effect of framing and legal role on the propensity to accept a settlement offer by litigants in a simulated legal dispute. Participants were given four different scenarios that factoria...