The non-effects of repeated exposure to the Cognitive Reflection Test
Journal Title: Judgment and Decision Making - Year 2018, Vol 13, Issue 3
Abstract
We estimate the effects of repeated exposure to the Cognitive Reflection Test (CRT) by examining 14,053 MTurk subjects who took the test up to 25 times. In contrast with inferences drawn from self-reported prior exposure to the CRT, we find that prior exposure usually fails to improve scores. On average, respondents get only 0.024 additional items correct per exposure, and this small increase is driven entirely by the minority of subjects who continue to spend time reflecting on the items. Moreover, later scores retain the predictive validity of earlier scores, even when they differ, because initial success and later improvement appear to measure the same thing.
Authors and Affiliations
Andrew Meyer, Elizabeth Zhou and Shane Frederick
Keywords
Related Articles
- EP ID EP678341
- DOI -
- Views 151
- Downloads 0
Bullshit makes the art grow profounder
Across four studies participants (N = 818) rated the profoundness of abstract art images accompanied with varying categories of titles, including: pseudo-profound bullshit titles (e.g., The Deaf Echo), mundane titles (e....
Coherence and correspondence in medicine
Many controversies in medical science can be framed as tension between a coherence approach (which seeks logic and explanation) and a correspondence approach (which emphasizes empirical correctness). In many instances, a...
Unconscious intuition or conscious analysis? Critical questions for the Deliberation-Without-Attention paradigm
The Deliberation without Attention (DWA) effect refers to apparent improvements in decision-making following a period of distraction. It has been presented as evidence for beneficial unconscious cognitive processes. We i...
Perceived time pressure and the Iowa Gambling Task
The purpose of the present study was to investigate the effect of perceived time pressure on a learning-based task called the Iowa Gambling Task (IGT). One hundred and sixty-three participants were randomly assigned to o...
Outcomes and expectations in dilemmas of trust
Rational trust decisions depend on potential outcomes and expectations of reciprocity. In the trust game, outcomes and expectations correspond to the structural factors of risk and temptation. Two experiments investigate...