Pair-wise comparisons of multiple models
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
Often research in judgment and decision making requires comparison of multiple competing models. Researchers invoke global measures such as the rate of correct predictions or the sum of squared (or absolute) deviations of the various models as part of this evaluation process. Reliance on such measures hides the (often very high) level of agreement between the predictions of the various models and does not highlight properly the relative performance of the competing models in those critical cases where they make distinct predictions. To address this important problem we propose the use of pair-wise comparisons of models to produce more informative and targeted comparisons of their performance, and we illustrate this procedure with data from two recently published papers. We use Multidimensional Scaling of these comparisons to map the competing models. We also demonstrate how intransitive cycles of pair-wise model performance can signal that certain models perform better for a given subset of decision problems.
Authors and Affiliations
Stephen B. Broomell, Budescu, David V. and Han-Hui Por
Keywords
Related Articles
- EP ID EP677865
- DOI -
- Views 127
- Downloads 0
Translation, cross-cultural adaptation, and reliability, of the Italian version of the Passive Risk Taking (PRT) Scale
The concept of “passive risk taking”, which refers to the risk brought on or magnified by inaction, has recently appeared in the literature on risk taking. Keinan and Bereby-Meyer (2012) have developed a scale to measure...
The impact of purchase quantity on the compromise effect: The balance heuristic
Most prior research on the compromise effect has focused on single rather than multiple choices. This research investigates the potential effects of purchase quantity on the compromise effect. We propose that the share o...
Are groups more likely to defer choice than their members?
When faced with a choice, people can normally select no option, i.e., defer choice. Previous research has investigated when and why individuals defer choice, but has almost never looked at these questions when groups of...
Spanish validation of General Decision-Making Style scale: Sex invariance, sex differences and relationships with personality and coping styles.
The General Decision-Making Styles (GDMS) scale measures five decision-making styles: rational, intuitive, dependent, avoidant and spontaneous. GDMS has been related to coping and some personality factors and sex-differe...
People respond to GM food with disgust more than fear: Comment on Royzman, Cusimano and Leeman (2017)
Scott, Inbar and Rozin (2016) reported an association between greater disgust sensitivity (DS) and more negative attitudes towards genetically modified (GM) food. Royzman, Cusimano and Leeman (2017) replicated this assoc...