Bayesian and frequentist analysis of True and Error models
Journal Title: Judgment and Decision Making - Year 2019, Vol 14, Issue 5
Abstract
Birnbaum and Quispe-Torreblanca (2018) presented a frequentist analysis of a family of six True and Error (TE) models for the analysis of two choice problems presented twice to each participant. Lee (2018) performed a Bayesian analysis of the same models, and found very similar parameter estimates and conclusions for the same data. He also discussed some potential differences between Bayesian and frequentist analyses and interpretations for model comparisons. This paper responds to certain points of possible controversy regarding model selection that attempt to take into account the concept of flexibility or complexity of a model. Reasons to question the use of Bayes factors to decide among models differing in fit and complexity are presented. The partially nested inter-relations among the six TE models are represented in a Venn diagram. Another view of model complexity is presented in terms of possible sets of data that could fit a model rather than in terms of possible sets of parameters that do or do not fit a given set of data. It is argued that less complex theories are not necessarily more likely to be true, and when the space of all possible theories is not well-defined, one should be cautious in interpreting calculated posterior probabilities that appear to prove a theory to be true.
Authors and Affiliations
Michael H. Birnbaum
Keywords
Related Articles
- EP ID EP678441
- DOI -
- Views 149
- Downloads 0
Ideology, motivated reasoning, and cognitive reflection
Decision scientists have identified various plausible sources of ideological polarization over climate change, gun violence, national security, and like issues that turn on empirical evidence. This paper describes a stud...
A simple remedy for overprecision in judgment
Overprecision is the most robust type of overconfidence. We present a new method that significantly reduces this bias and offers insight into its underlying cause. In three experiments, overprecision was significantly re...
A novel approach to studying strategic decisions with eye-tracking and machine learning
We propose a novel method of using eye-tracking to study strategic decisions. The conventional approach is to hypothesize what eye-patterns should be observed if a given model of decision-making was accurate, and then pr...
Overlap of accessible information undermines the anchoring effect
According to the Selective Accessibility Model of anchoring, the comparison question in the standard anchoring paradigm activates information that is congruent with an anchor. As a consequence, this information will be m...
Relative thinking in consumer choice between differentiated goods and services and its implications for business strategy
The article shows that when people consider differentiated goods or services that differ in price and quality, they exhibit a decision-making bias of “relative thinking”: relative price differences affect them even when...