Information search with situation-specific reward functions
Journal Title: Judgment and Decision Making - Year 2012, Vol 7, Issue 2
Abstract
The goal of obtaining information to improve classification accuracy can strongly conflict with the goal of obtaining information for improving payoffs. Two environments with such a conflict were identified through computer optimization. Three subsequent experiments investigated people’s search behavior in these environments. Experiments 1 and 2 used a multiple-cue probabilistic category-learning task to convey environmental probabilities. In a subsequent search task subjects could query only a single feature before making a classification decision. The crucial manipulation concerned the search-task reward structure. The payoffs corresponded either to accuracy, with equal rewards associated with the two categories, or to an asymmetric payoff function, with different rewards associated with each category. In Experiment 1, in which learning-task feedback corresponded to the true category, people later preferentially searched the accuracy-maximizing feature, whether or not this would improve monetary rewards. In Experiment 2, an asymmetric reward structure was used during learning. Subjects searched the reward-maximizing feature when asymmetric payoffs were preserved in the search task. However, if search-task payoffs corresponded to accuracy, subjects preferentially searched a feature that was suboptimal for reward and accuracy alike. Importantly, this feature would have been most useful, under the learning-task payoff structure. Experiment 3 found that, if words and numbers are used to convey environmental probabilities, neither reward nor accuracy consistently predicts search. These findings emphasize the necessity of taking into account people’s goals and search-and-decision processes during learning, thereby challenging current models of information search.
Authors and Affiliations
Björn Meder and Jonathan D. Nelson
Keywords
Related Articles
- EP ID EP677879
- DOI -
- Views 135
- Downloads 0
Translation, cross-cultural adaptation, and reliability, of the Italian version of the Passive Risk Taking (PRT) Scale
The concept of “passive risk taking”, which refers to the risk brought on or magnified by inaction, has recently appeared in the literature on risk taking. Keinan and Bereby-Meyer (2012) have developed a scale to measure...
Allowing repeat winners
Unbiased lotteries seem the least unfair and simplest procedures to allocate scarce indivisible resources to those with equal claims. But, when lotteries are repeated, it is not immediately obvious whether prior winners...
The Drift Diffusion Model can account for the accuracy and reaction time of value-based choices under high and low time pressure
An important open problem is how values are compared to make simple choices. A natural hypothesis is that the brain carries out the computations associated with the value comparisons in a manner consistent with the Drift...
Reflective liberals and intuitive conservatives: A look at the Cognitive Reflection Test and ideology
Prior research finds that liberals and conservatives process information differently. Predispositions toward intuitive versus reflective thinking may help explain this individual level variation. There have been few dire...
The effect of limited availability on children’s consumption, engagement, and choice behavior
Three studies examine the effect of limited availability on the engagement, consumption, and choice behavior of four- to five-year old children. It is shown that children engage longer in an activity when the activity is...