Bayesian and frequentist analysis of True and Error models
Journal Title: Judgment and Decision Making - Year 2019, Vol 14, Issue 5
Abstract
Birnbaum and Quispe-Torreblanca (2018) presented a frequentist analysis of a family of six True and Error (TE) models for the analysis of two choice problems presented twice to each participant. Lee (2018) performed a Bayesian analysis of the same models, and found very similar parameter estimates and conclusions for the same data. He also discussed some potential differences between Bayesian and frequentist analyses and interpretations for model comparisons. This paper responds to certain points of possible controversy regarding model selection that attempt to take into account the concept of flexibility or complexity of a model. Reasons to question the use of Bayes factors to decide among models differing in fit and complexity are presented. The partially nested inter-relations among the six TE models are represented in a Venn diagram. Another view of model complexity is presented in terms of possible sets of data that could fit a model rather than in terms of possible sets of parameters that do or do not fit a given set of data. It is argued that less complex theories are not necessarily more likely to be true, and when the space of all possible theories is not well-defined, one should be cautious in interpreting calculated posterior probabilities that appear to prove a theory to be true.
Authors and Affiliations
Michael H. Birnbaum
Keywords
Related Articles
- EP ID EP678441
- DOI -
- Views 164
- Downloads 0
How to study cognitive decision algorithms: The case of the priority heuristic
Although the priority heuristic (PH) is conceived as a cognitive-process model, some of its critical process assumptions remain to be tested. The PH makes very strong ordinal and quantitative assumptions about the strict...
You don’t want to know what you’re missing: When information about forgone rewards impedes dynamic decision making
When people learn to make decisions from experience, a reasonable intuition is that additional relevant information should improve their performance. In contrast, we find that additional information about foregone reward...
Numeracy as a precursor to pro-social behavior: The impact of numeracy and presentation format on the cognitive mechanisms underlying donation decisions
Donation requests often convey numerical information about the people in need. In two studies we investigated the effects of numeracy and presentation format on the underlying affective and cognitive mechanisms of donati...
Domain-specific temporal discounting and temptation
In this investigation, we test whether temporal discounting is domain-specific (i.e., compared to other people, can an individual have a relatively high discount rate for one type of reward but a relatively low discount...
Simple eye movement metrics can predict future decision making performance: The case of financial choices
Decisions are often delegated to experts chosen based on their past performance record which may be subject to noise. For instance, a person with little skill could still make a lucky decision that proves correct ex-post...