Diagnostic Task Selection for Strategy Classification in Judgment and Decision Making: Theory, Validation, and Implementation in R
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
One major statistical and methodological challenge in Judgment and Decision Making research is the reliable identification of individual decision strategies by selection of diagnostic tasks, that is, tasks for which predictions of the strategies differ sufficiently. The more strategies are considered, and the larger the number of dependent measures simultaneously taken into account in strategy classification (e.g., choices, decision time, confidence ratings; Glöckner, 2009), the more complex the selection of the most diagnostic tasks becomes. We suggest the Euclidian Diagnostic Task Selection (EDTS) method as a standardized solution for the problem. According to EDTS, experimental tasks are selected that maximize the average difference between strategy predictions for any multidimensional prediction space. In a comprehensive model recovery simulation, we evaluate and quantify the influence of diagnostic task selection on identification rates in strategy classification. Strategy classification with EDTS shows superior performance in comparison to less diagnostic task selection algorithms such as representative sampling. The advantage of EDTS is particularly large if only few dependent measures are considered. We also provide an easy-to-use function in the free software package R that allows generating predictions for the most commonly considered strategies for a specified set of tasks and evaluating the diagnosticity of those tasks via EDTS; thus, to apply EDTS, no prior programming knowledge is necessary.
Authors and Affiliations
Marc Jekel, Susann Fiedler and Andreas Glöckner
Keywords
Related Articles
- EP ID EP677862
- DOI -
- Views 112
- Downloads 0
Solving stumpers, CRT and CRAT: Are the abilities related?
Bar-Hillel, Noah and Frederick (2018) studied a class of riddles they called stumpers, which have simple, but curiously elusive, solutions. A canonical example is: “Andy is Bobbie’s brother, but Bobbie is not Andy’s brot...
The environment matters: Comparing individuals and dyads in their adaptive use of decision strategies
Individuals have been shown to adaptively select decision strategies depending on the environment structure. Two experiments extended this research to the group level. Subjects (N = 240) worked either individually or in...
Are buyers of apartments superstitious? Evidence from the Russian real estate market
We study the influence of numerological superstitions on people’s buying behavior in the apartment market using unique actual sales data. Based on the dataset from Saint-Petersburg primary real estate market we compare t...
A method to elicit beliefs as most likely intervals
We show how to elicit the beliefs of an expert in the form of a “most likely interval”, a set of future outcomes that are deemed more likely than any other outcome. Our method, called the Most Likely Interval elicitation...
Reluctant altruism and peer pressure in charitable giving
Subjects donate individually (control group) or in pairs (treatment group). Those in pairs reveal their donation decision to each other. Average donations in the treatment group are significantly higher than in the contr...