Measuring Risk Literacy: The Berlin Numeracy Test
Journal Title: Judgment and Decision Making - Year 2012, Vol 7, Issue 1
Abstract
We introduce the Berlin Numeracy Test, a new psychometrically sound instrument that quickly assesses statistical numeracy and risk literacy. We present 21 studies (n=5336) showing robust psychometric discriminability across 15 countries (e.g., Germany, Pakistan, Japan, USA) and diverse samples (e.g., medical professionals, general populations, Mechanical Turk web panels). Analyses demonstrate desirable patterns of convergent validity (e.g., numeracy, general cognitive abilities), discriminant validity (e.g., personality, motivation), and criterion validity (e.g., numerical and non-numerical questions about risk). The Berlin Numeracy Test was found to be the strongest predictor of comprehension of everyday risks (e.g., evaluating claims about products and treatments; interpreting forecasts), doubling the predictive power of other numeracy instruments and accounting for unique variance beyond other cognitive tests (e.g., cognitive reflection, working memory, intelligence). The Berlin Numeracy Test typically takes about three minutes to complete and is available in multiple languages and formats, including a computer adaptive test that automatically scores and reports data to researchers (www.riskliteracy.org). The online forum also provides interactive content for public outreach and education, and offers a recommendation system for test format selection. Discussion centers on construct validity of numeracy for risk literacy, underlying cognitive mechanisms, and applications in adaptive decision support.
Authors and Affiliations
Edward T. Cokely, Mirta Galesic, Eric Schulz, Saima Ghazal and Rocio Garcia-Retamero
Keywords
Related Articles
- EP ID EP677872
- DOI -
- Views 190
- Downloads 0
A cautionary note on global recalibration
We report a mathematical result that casts doubt on the possibility of recalibration of probabilities using calibration curves. We then discuss how to interpret this result in the light of behavioral research.
Gambler’s fallacy, hot hand belief, and the time of patterns
The gambler’s fallacy and the hot hand belief have been classified as two exemplars of human misperceptions of random sequential events. This article examines the times of pattern occurrences where a fair or biased coin...
Bayesian methods for analyzing true-and-error models
Birnbaum and Quispe-Torreblanca (2018) evaluated a set of six models developed under true-and-error theory against data in which people made choices in repeated gambles. They concluded the three models based on expected...
The effects of behavioral and outcome feedback on prudent decision-making under conditions of present and future uncertainty
One of the largest reasons decision-makers make bad decisions (act imprudently) is that the world is full of uncertainty, we feel uncertain about the consequences of our actions. Participants played a repeated game in wh...
WTP and WTA in competitive and non-competitive environments
Theoretical equivalence exists among various auction mechanisms, specifically the Second-Price-Auction (SPA), a competitive environment, and the BDM mechanism, a non-competitive environment. Yet, empirical studies sugges...