A universal method for evaluating the quality of aggregators
Journal Title: Judgment and Decision Making - Year 2019, Vol 14, Issue 4
Abstract
We propose a new method to facilitate comparison of aggregated forecasts based on different aggregation, elicitation and calibration methods. Aggregates are evaluated by their relative position on the cumulative distribution of the corresponding individual scores. This allows one to compare methods using different measures of quality that use different scales. We illustrate the use of the method by re-analyzing various estimates from Budescu and Du (Management Science, 2007).
Authors and Affiliations
Ying Han and David Budescu
Keywords
Related Articles
- EP ID EP678426
- DOI -
- Views 164
- Downloads 0
Is variety the spice of life? It all depends on the rate of consumption
Is variety of the spice of life? The present research suggests that the answer depends on the rate of consumption. In three experiments, we find that, whereas a variety of stimuli is preferred to repetition of even a bet...
Exemplar-based inference in multi-attribute decision making: Contingent, not automatic, strategy shifts?
Several studies propose that exemplar retrieval contributes to multi-attribute decisions. The authors have proposed a process theory enabling a priori predictions of what cognitive representations people use as input to...
The effects of anticipated regret on risk preferences of social and problem gamblers
Anticipated regret is an important determinant in risky decision making, however only a few studies have explored its role in problem gambling. This study tested for differences in the anticipation of regret among social...
Glucose promotes controlled processing: Matching, maximizing, and root beer
Participants drank either regular root beer or sugar-free diet root beer before working on a probability-learning task in which they tried to predict which of two events would occur on each of 200 trials. One event (E1)...
Think or blink — is the recognition heuristic an “intuitive” strategy?
Several approaches to judgment and decision making emphasize the effort-reducing properties of heuristics. One prominent example for effort-reduction is the recognition heuristic (RH) which proposes that judgments are ma...