True-and-error models violate independence and yet they are testable
Journal Title: Judgment and Decision Making - Year 2013, Vol 8, Issue 6
Abstract
Birnbaum (2011) criticized tests of transitivity that are based entirely on binary choice proportions. When assumptions of independence and stationarity (iid) of choice responses are violated, choice proportions could lead to wrong conclusions. Birnbaum (2012a) proposed two statistics (correlation and variance of preference reversals) to test iid, using random permutations to simulate p-values. Cha, Choi, Guo, Regenwetter, and Zwilling (2013) defended methods based on marginal proportions but conceded that such methods wrongly diagnose hypothetical examples of Birnbaum (2012a). However, they also claimed that “true and error” models also satisfy independence and also fail in such cases unless they become untestable. This article presents correct true-and-error models; it shows how these models violate iid, how they might correctly identify cases that would be misdiagnosed by marginal proportions, and how they can be tested and rejected. This note also refutes other arguments of Cha et al. (2013), including contentions that other tests failed to violate iid “with flying colors”, that violations of iid “do not replicate”, that type I errors are not appropriately estimated by the permutation method, and that independence assumptions are not critical to interpretation of marginal choice proportions.
Authors and Affiliations
Michael H. Birnbaum
Keywords
Related Articles
- EP ID EP678104
- DOI -
- Views 153
- Downloads 0
Top scores are possible, bottom scores are certain (and middle scores are not worth mentioning): A pragmatic view of verbal probabilities
In most previous studies of verbal probabilities, participants are asked to translate expressions such as possible and not certain into numeric probability values. This probabilistic translation approach can be contraste...
Contingency inferences driven by base rates: Valid by sampling
Fiedler et al. (2009), reviewed evidence for the utilization of a contingency inference strategy termed pseudocontingencies (PCs). In PCs, the more frequent levels (and, by implication, the less frequent levels) are assu...
Maximizers versus satisficers: Decision-making styles, competence, and outcomes
Our previous research suggests that people reporting a stronger desire to maximize obtain worse life outcomes (Bruine de Bruin et al., 2007). Here, we examine whether this finding may be explained by the decision-making...
The Drift Diffusion Model can account for the accuracy and reaction time of value-based choices under high and low time pressure
An important open problem is how values are compared to make simple choices. A natural hypothesis is that the brain carries out the computations associated with the value comparisons in a manner consistent with the Drift...
Goal center width, how to count sequences, and the gambler’s fallacy in goal penalty shootouts
Previous research has reported that the gambler’s fallacy could be detected in goalkeepers’ behavior during penalty shootouts. Following repeated kicks in the same direction, goalkeepers were more likely to dive in the o...