The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Journal Title: Judgment and Decision Making - Year 2015, Vol 10, Issue 5
Abstract
Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.
Authors and Affiliations
Neil Stewart, Christoph Ungemach, Adam J. L. Harris, Daniel M. Bartels, Ben R. Newell, Gabriele Paolacci and Jesse Chandler
Keywords
Related Articles
- EP ID EP678200
- DOI -
- Views 112
- Downloads 0
Cognition in the woods: Biases in probability judgments by search and rescue planners
A type of emergency decision-making which has not received research attention is the police search for a lost person in a rural or wilderness area. For many such incidents, decisions concerning where to search for the lo...
Validation and invariance across age and gender for the Melbourne Decision-Making Questionnaire in a sample of Portuguese adults
The personal pattern of coping with the stress associated with making decisions characterizes the way an individual makes choices and judgments. The Melbourne Decision Making Questionnaire (MDMQ) analyses these personal...
True-and-error models violate independence and yet they are testable
Birnbaum (2011) criticized tests of transitivity that are based entirely on binary choice proportions. When assumptions of independence and stationarity (iid) of choice responses are violated, choice proportions could le...
Are medical treatments for individuals and groups like single-play and multiple-play gambles?
People are often more likely to accept risky monetary gambles with positive expected values when the gambles will be played more than once. We investigated whether this distinction between single-play and multiple-play g...
When uncertainty meets life: The effect of animacy on probability expression
Everyone faces uncertainty on a daily basis. Two kinds of probability expressions, verbal and numerical, have been used to characterize the uncertainty that we face. Because our cognitive concept of living things differs...