Belief bias and representation in assessing the Bayesian rationality of others
Journal Title: Judgment and Decision Making - Year 2019, Vol 14, Issue 1
Abstract
People often assess the reasonableness of another person’s judgments. When doing so, the evaluator should set aside knowledge that would not have been available to the evaluatee to assess whether the evaluatee made a reasonable decision, given the available information. But under what circumstances does the evaluator set aside information? On the one hand, if the evaluator fails to set aside prior information, not available to the evaluatee, they exhibit belief bias. But on the other hand, when Bayesian inference is called for, the evaluator should generally incorporate prior knowledge about relevant probabilities in decision making. The present research integrated these two perspectives in two experiments. Participants were asked to take the perspective of a fictitious evaluatee and to evaluate the reasonableness of the evaluatee’s decision. The participant was privy to information that the fictitious evaluatee did not have. Specifically, the participant knew whether the evaluatee’s decision judgment was factually correct. Participants’ judgments were biased (Experiments 1 and 2) by the factuality of the conclusion as they assessed the evaluatee’s reasonableness. We also found that the format of information presentation (Experiment 2) influenced the degree to which participants’ reasonableness ratings were responsive to the evaluatee’s Bayesian rationality. Specifically, responsivity was greater when the information was presented in an icon-based, graphical, natural-frequency format than when presented in either a numerical natural-frequency format or a probability format. We interpreted the effects of format to suggest that graphical presentation can help organize information into nested sets, which in turn enhances Bayesian rationality.
Authors and Affiliations
Richard B. Anderson, Laura Marie Leventhal, Don C. Zhang, Daniel Fasko, Jr. , Zachariah Basehore, Christopher Gamsby, Jared Branch and Timothy Patrick
Cue integration vs. exemplar-based reasoning in multi-attribute decisions from memory: A matter of cue representation
Inferences about target variables can be achieved by deliberate integration of probabilistic cues or by retrieving similar cue-patterns (exemplars) from memory. In tasks with cue information presented in on-screen displa...
The Short Maximization Inventory
We developed the Short Maximization Inventory (SMI) by shortening the Maximization Inventory (Turner, Rim, Betz & Nygren, 2012) from 34 items to 15 items. Using the Item Response Theory framework, we identified and remov...
Methodological notes on model comparisons and strategy classification: A falsificationist proposition
Taking a falsificationist perspective, the present paper identifies two major shortcomings of existing approaches to comparative model evaluations in general and strategy classifications in particular. These are (1) fail...
Responsibility judgments of wins and losses in the 2013 chess championship
We report two studies on the perceived responsibility of opponents competing for a goal that can be attained by only one of them. Responsibility judgments were collected in seven samples of lay people and experts before,...
A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
People often perform poorly on stock-flow reasoning tasks, with many (but not all) participants appearing to erroneously match the accumulation of the stock to the inflow – a response pattern attributed to the use of a “...