True-and-error models violate independence and yet they are testable
Journal Title: Judgment and Decision Making - Year 2013, Vol 8, Issue 6
Abstract
Birnbaum (2011) criticized tests of transitivity that are based entirely on binary choice proportions. When assumptions of independence and stationarity (iid) of choice responses are violated, choice proportions could lead to wrong conclusions. Birnbaum (2012a) proposed two statistics (correlation and variance of preference reversals) to test iid, using random permutations to simulate p-values. Cha, Choi, Guo, Regenwetter, and Zwilling (2013) defended methods based on marginal proportions but conceded that such methods wrongly diagnose hypothetical examples of Birnbaum (2012a). However, they also claimed that “true and error” models also satisfy independence and also fail in such cases unless they become untestable. This article presents correct true-and-error models; it shows how these models violate iid, how they might correctly identify cases that would be misdiagnosed by marginal proportions, and how they can be tested and rejected. This note also refutes other arguments of Cha et al. (2013), including contentions that other tests failed to violate iid “with flying colors”, that violations of iid “do not replicate”, that type I errors are not appropriately estimated by the permutation method, and that independence assumptions are not critical to interpretation of marginal choice proportions.
Authors and Affiliations
Michael H. Birnbaum
Keywords
Related Articles
- EP ID EP678104
- DOI -
- Views 144
- Downloads 0
Risk perception and risk attitudes in Tokyo: A report of the first administration of DOSPERT+M in Japan
Background: The Domain-Specific Risk Taking scale (DOSPERT) has been used to measure risk perceptions and attitudes in several nations and cultures. Takahashi translated DOSPERT to Japanese but DOSPERT responses from Jap...
Diagnostic Task Selection for Strategy Classification in Judgment and Decision Making: Theory, Validation, and Implementation in R
One major statistical and methodological challenge in Judgment and Decision Making research is the reliable identification of individual decision strategies by selection of diagnostic tasks, that is, tasks for which pred...
A medical risk attitude subscale for DOSPERT
Background: The Domain-Specific Risk Taking scale (DOSPERT) is a widely used instrument that measures perceived risk and benefit and attitude toward risk for activities in several domains, but does not include medical ri...
Introducing money at any time can reduce discounting in intertemporal choices with rewards: An extension of the upfront money effect
To study intertemporal choices, researchers typically instruct subjects to choose between smaller and sooner (SS) and larger and later (LL) rewards (e.g., gaining CNY 210 in a week vs. gaining CNY 250 in five weeks). Peo...
Does menu design influence retirement investment choices? Evidence from Italian occupational pension funds
Previous research has demonstrated that consumers’ decisions regarding supplementary pensions could be affected by biases. Bernatzi and Thaler’s experiment demonstrated that menu design can influence pension fund enrollm...