What might judgment and decision making research be like if we took a Bayesian approach to hypothesis testing?
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
Judgment and decision making research overwhelmingly uses null hypothesis significance testing as the basis for statistical inference. This article examines an alternative, Bayesian approach which emphasizes the choice between two competing hypotheses and quantifies the balance of evidence provided by the data—one consequence of which is that experimental results may be taken to strongly favour the null hypothesis. We apply a recently-developed “Bayesian t-test” to existing studies of the anchoring effect in judgment, and examine how the change in approach affects both the tone of hypothesis testing and the substantive conclusions that one draws. We compare the Bayesian approach with Fisherian and Neyman-Pearson testing, examining its relationship to conventional p-values, the influence of effect size, and the importance of prior beliefs about the likely state of nature. The results give a sense of how Bayesian hypothesis testing might be applied to judgment and decision making research, and of both the advantages and challenges that a shift to this approach would entail.
Authors and Affiliations
William J. Matthews
Keywords
Related Articles
- EP ID EP677867
- DOI -
- Views 158
- Downloads 0
Bayesian methods for analyzing true-and-error models
Birnbaum and Quispe-Torreblanca (2018) evaluated a set of six models developed under true-and-error theory against data in which people made choices in repeated gambles. They concluded the three models based on expected...
Developing expert political judgment: The impact of training and practice on judgmental accuracy in geopolitical forecasting tournaments
The heuristics-and-biases research program highlights reasons for expecting people to be poor intuitive forecasters. This article tests the power of a cognitive-debiasing training module (“CHAMPS KNOW”) to improve probab...
Strategies for exploration in the domain of losses
Many decisions in everyday life involve a choice between exploring options that are currently unknown and exploiting options that are already known to be rewarding. Previous work has suggested that humans solve such “exp...
Fear and loathing in Las Vegas: Evidence from blackjack tables
This paper uses proprietary data from a blackjack table in Las Vegas to analyze how the expectation of regret affects peoples’ decisions during gambles. Even among a group of people who choose to participate in a risk-ta...
Reversing the endowment effect
When given a desirable item, people have a tendency to value this owned item more than an equally-desirable, unowned item. Conversely, when the endowed item is undesirable, in some circumstances people have a tendency to...