How different types of participant payments alter task performance
Journal Title: Judgment and Decision Making - Year 2009, Vol 4, Issue 5
Abstract
Researchers typically use incentives (such as money or course credit) in order to obtain participants who engage in the specific behaviors of interest to the researcher. There is, however, little understanding or agreement on the effects of different types and levels of incentives used. Some results in the domain of statistical reasoning suggest that performance differences — previously deemed theoretically important — may actually be due to differences in incentive types across studies. 704 participants completed one of five variants of a statistical reasoning task, for which they received either course credit, flat fee payment, or performance-based payment incentives. Successful task completion was more frequent with performance-based incentives than with either of the other incentive types. Performance on moderately difficult tasks (compared to very easy and very hard tasks) was most sensitive to incentives. These results can help resolve existing debates about inconsistent findings, guide more accurate comparisons across studies, and be applied beyond research settings.
Authors and Affiliations
Gary L. Brase
Are good reasoners more incest-friendly? Trait cognitive reflection predicts selective moralization in a sample of American adults
Two studies examined the relationship between individual differences in cognitive reflection (CRT) and the tendency to accord genuinely moral (non-conventional) status to a range of counter-normative acts — that is, to t...
"Head versus heart": Effect of monetary frames on expression of sympathetic magical concerns
Most American respondents give "irrational," magical responses in a variety of situations that exemplify the sympathetic magical laws of similarity and contagion. In most of these cases, respondents are aware that their...
Beyond reach: Do symmetric changes in motor costs affect decision making? A registered report
Executing an important decision can be as easy as moving a mouse cursor or reaching towards the preferred option with a hand. But would we decide differently if choosing required walking a few steps towards an option? Mo...
How the number of options and perceived variety influence choice satisfaction: An experiment with prescription drug plans
This study measures the perceived costs, perceived benefits, choice outcome satisfaction, and choice process satisfaction from consumers making hypothetical choices amongst prescription drug plans. I juxtapose the number...
Forecasting elections with mere recognition from small, lousy samples: A comparison of collective recognition, wisdom of crowds, and representative polls
We investigated the extent to which the human capacity for recognition helps to forecast political elections: We compared naïve recognition-based election forecasts computed from convenience samples of citizens’ recognit...