Repeated judgment sampling: Boundaries
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 4
Abstract
This paper investigates the boundaries of the recent result that eliciting more than one estimate from the same person and averaging these can lead to accuracy gains in judgment tasks. It first examines its generality, analysing whether the kind of question being asked has an effect on the size of potential gains. Experimental results show that the question type matters. Previous results reporting potential accuracy gains are reproduced for year-estimation questions, and extended to questions about percentage shares. On the other hand, no gains are found for general numerical questions. The second part of the paper tests repeated judgment sampling’s practical applicability by asking judges to provide a third and final answer on the basis of their first two estimates. In an experiment, the majority of judges do not consistently average their first two answers. As a result, they do not realise the potential accuracy gains from averaging.
Authors and Affiliations
Johannes Müller-Trede
Framing effect in evaluation of others’ predictions
This paper explored how frames influence people’s evaluation of others’ probabilistic predictions in light of the outcomes of binary events. Most probabilistic predictions (e.g., “there is a 75% chance that Denver will w...
An attempt to clarify the link between cognitive style and political ideology: A non-western replication and extension
Previous studies relating low-effort or intuitive thinking to political conservatism are limited to Western cultures. Using Turkish and predominantly Muslim samples, Study 1 found that analytic cognitive style (ACS) is n...
Simple eye movement metrics can predict future decision making performance: The case of financial choices
Decisions are often delegated to experts chosen based on their past performance record which may be subject to noise. For instance, a person with little skill could still make a lucky decision that proves correct ex-post...
Moral investing: Psychological motivations and implications
In four experiments we showed that investors are not only interested in maximizing returns but have non-financial goals, too. We considered what drives the decision to invest ethically and the impact this strategy has on...
Improving dynamic decision making through training and self-reflection
The modern business environment requires managers to make effective decisions in a dynamic and uncertain world. How can such dynamic decision making (DDM) improve? The current study investigated the effects of brief trai...