A statistical test of independence in choice data with small samples

Journal Title: Judgment and Decision Making - Year 2012, Vol 7, Issue 1

Abstract

This paper develops tests of independence and stationarity in choice data collected with small samples. The method builds on the approach of Smith and Batchelder (2008). The technique is intended to distinguish cases where a person is systematically changing “true” preferences (from one group of trials to another) from cases in which a person is following a random preference mixture model with independently and identically distributed sampling in each trial. Preference reversals are counted between all pairs of repetitions. The variance of these preference reversals between all pairs of repetitions is then calculated. The distribution of this statistic is simulated by a Monte Carlo procedure in which the data are randomly permuted and the statistic is recalculated in each simulated sample. A second test computes the correlation between the mean number of preference reversals and the difference between replicates, which is also simulated by Monte Carlo. Data of Regenwetter, Dana, and Davis-Stober (2011) are reanalyzed by this method. Eight of 18 subjects showed significant deviations from the independence assumptions by one or both of these tests, which is significantly more than expected by chance.

Authors and Affiliations

Michael H. Birnbaum

Keywords

Related Articles

New designs for research in delay discounting

The two most influential models in delay discounting research have been the exponential (E) and hyperbolic (H) models. We develop a new methodology to design binary choice questions such that exponential and hyperbolic d...

The skill element in decision making under uncertainty: Control or competence?

Many natural decisions contain an element of skill. Modern conceptions of the skill component include control (Goodie, 2003) and competence (Heath & Tversky, 1991). The control hypothesis states that a task's skill compo...

Are markets more accurate than polls? The surprising informational value of “just asking”

Psychologists typically measure beliefs and preferences using self-reports, whereas economists are much more likely to infer them from behavior. Prediction markets appear to be a victory for the economic approach, having...

Why do professional athletes have different time preferences than non-athletes?

The objective of this paper is to measure and compare the subjective time discounting of professional athletes and non-athletes. By using a questionnaire, we found higher subjective discounting for professional athletes...

Framing effects on bidding behavior in experimental first-price sealed-bid money auctions

Consumers often face prices that are the sum of two components, for example, an online purchase that includes a stated price and shipping costs. In such cases consumer behavior may be influenced by framing, i.e., how the...

Download PDF file
  • EP ID EP677877
  • DOI -
  • Views 163
  • Downloads 0

How To Cite

Michael H. Birnbaum (2012). A statistical test of independence in choice data with small samples. Judgment and Decision Making, 7(1), -. https://europub.co.uk/articles/-A-677877