Diagnostic Task Selection for Strategy Classification in Judgment and Decision Making: Theory, Validation, and Implementation in R
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
One major statistical and methodological challenge in Judgment and Decision Making research is the reliable identification of individual decision strategies by selection of diagnostic tasks, that is, tasks for which predictions of the strategies differ sufficiently. The more strategies are considered, and the larger the number of dependent measures simultaneously taken into account in strategy classification (e.g., choices, decision time, confidence ratings; Glöckner, 2009), the more complex the selection of the most diagnostic tasks becomes. We suggest the Euclidian Diagnostic Task Selection (EDTS) method as a standardized solution for the problem. According to EDTS, experimental tasks are selected that maximize the average difference between strategy predictions for any multidimensional prediction space. In a comprehensive model recovery simulation, we evaluate and quantify the influence of diagnostic task selection on identification rates in strategy classification. Strategy classification with EDTS shows superior performance in comparison to less diagnostic task selection algorithms such as representative sampling. The advantage of EDTS is particularly large if only few dependent measures are considered. We also provide an easy-to-use function in the free software package R that allows generating predictions for the most commonly considered strategies for a specified set of tasks and evaluating the diagnosticity of those tasks via EDTS; thus, to apply EDTS, no prior programming knowledge is necessary.
Authors and Affiliations
Marc Jekel, Susann Fiedler and Andreas Glöckner
The representativeness heuristic and the choice of lottery tickets: A field experiment
The representativeness heuristic (RH) has been proposed to be at the root of several types of biases in judgment. In this project, we ask whether the RH is relevant in two kinds of choices in the context of gambling. Spe...
Downside financial risk is misunderstood
The mathematics of downside financial risk can be difficult to understand: For example a 50% loss requires a subsequent 100% gain to break-even. A given percentage loss always requires a greater percentage gain to break-...
Anticipatory stress interferes with utilitarian moral judgment
A recent study indicates that acute stress affects moral decision making (Youssef et al., in press). The current study examines whether results can be replicated using a different kind of stressor and a different kind of...
The impact of purchase quantity on the compromise effect: The balance heuristic
Most prior research on the compromise effect has focused on single rather than multiple choices. This research investigates the potential effects of purchase quantity on the compromise effect. We propose that the share o...
The role of cognitive reflection in decision making: Evidence from Pakistani managers
Assessing how managers discount and evaluate risks is crucial in designing effective managerial policies. In this work, we examine whether risk preferences (RP; both in the domains of gain and loss) and time preferences...