Diagnostic Task Selection for Strategy Classification in Judgment and Decision Making: Theory, Validation, and Implementation in R
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
One major statistical and methodological challenge in Judgment and Decision Making research is the reliable identification of individual decision strategies by selection of diagnostic tasks, that is, tasks for which predictions of the strategies differ sufficiently. The more strategies are considered, and the larger the number of dependent measures simultaneously taken into account in strategy classification (e.g., choices, decision time, confidence ratings; Glöckner, 2009), the more complex the selection of the most diagnostic tasks becomes. We suggest the Euclidian Diagnostic Task Selection (EDTS) method as a standardized solution for the problem. According to EDTS, experimental tasks are selected that maximize the average difference between strategy predictions for any multidimensional prediction space. In a comprehensive model recovery simulation, we evaluate and quantify the influence of diagnostic task selection on identification rates in strategy classification. Strategy classification with EDTS shows superior performance in comparison to less diagnostic task selection algorithms such as representative sampling. The advantage of EDTS is particularly large if only few dependent measures are considered. We also provide an easy-to-use function in the free software package R that allows generating predictions for the most commonly considered strategies for a specified set of tasks and evaluating the diagnosticity of those tasks via EDTS; thus, to apply EDTS, no prior programming knowledge is necessary.
Authors and Affiliations
Marc Jekel, Susann Fiedler and Andreas Glöckner
Keywords
Related Articles
- EP ID EP677862
- DOI -
- Views 139
- Downloads 0
Are markets more accurate than polls? The surprising informational value of “just asking”
Psychologists typically measure beliefs and preferences using self-reports, whereas economists are much more likely to infer them from behavior. Prediction markets appear to be a victory for the economic approach, having...
Deception and price in a market with asymmetric information
In markets with asymmetric information, only sellers have knowledge about the quality of goods. Sellers may of course make a declaration of the quality, but unless there are sanctions imposed on false declarations or rep...
The non-effects of repeated exposure to the Cognitive Reflection Test
We estimate the effects of repeated exposure to the Cognitive Reflection Test (CRT) by examining 14,053 MTurk subjects who took the test up to 25 times. In contrast with inferences drawn from self-reported prior exposure...
Vulnerable maximizers: The role of decision difficulty
Adding to prior literature that has examined the relationship between maximization and dissatisfaction, the present research suggests that maximizers, as defined by the original maximization scale, are unhappier decision...
“I am uncertain” vs “It is uncertain”. How linguistic markers of the uncertainty source affect uncertainty communication
Two psychological sources of uncertainty bear implications for judgment and decision-making: external uncertainty is seen as stemming from properties of the world, whereas internal uncertainty is seen as stemming from la...