Information search with situation-specific reward functions
Journal Title: Judgment and Decision Making - Year 2012, Vol 7, Issue 2
Abstract
The goal of obtaining information to improve classification accuracy can strongly conflict with the goal of obtaining information for improving payoffs. Two environments with such a conflict were identified through computer optimization. Three subsequent experiments investigated people’s search behavior in these environments. Experiments 1 and 2 used a multiple-cue probabilistic category-learning task to convey environmental probabilities. In a subsequent search task subjects could query only a single feature before making a classification decision. The crucial manipulation concerned the search-task reward structure. The payoffs corresponded either to accuracy, with equal rewards associated with the two categories, or to an asymmetric payoff function, with different rewards associated with each category. In Experiment 1, in which learning-task feedback corresponded to the true category, people later preferentially searched the accuracy-maximizing feature, whether or not this would improve monetary rewards. In Experiment 2, an asymmetric reward structure was used during learning. Subjects searched the reward-maximizing feature when asymmetric payoffs were preserved in the search task. However, if search-task payoffs corresponded to accuracy, subjects preferentially searched a feature that was suboptimal for reward and accuracy alike. Importantly, this feature would have been most useful, under the learning-task payoff structure. Experiment 3 found that, if words and numbers are used to convey environmental probabilities, neither reward nor accuracy consistently predicts search. These findings emphasize the necessity of taking into account people’s goals and search-and-decision processes during learning, thereby challenging current models of information search.
Authors and Affiliations
Björn Meder and Jonathan D. Nelson
Keywords
Related Articles
- EP ID EP677879
- DOI -
- Views 156
- Downloads 0
Divergence between individual perceptions and objective indicators of tail risks: Evidence from floodplain residents in New York City
This study provides the first comprehensive analysis of individual perceptions of tail risks. It focuses not only on the probability, as has been studied by Nicholas Barberis and others, but also on anticipation of damag...
Improving dynamic decision making through training and self-reflection
The modern business environment requires managers to make effective decisions in a dynamic and uncertain world. How can such dynamic decision making (DDM) improve? The current study investigated the effects of brief trai...
Deconstructing the seductive allure of neuroscience explanations
Previous work showed that people find explanations more satisfying when they contain irrelevant neuroscience information. The current studies investigate why this effect happens. In Study 1 (N=322), subjects judged psych...
Inferring uncertainty from interval estimates: Effects of alpha level and numeracy
Interval estimates are commonly used to descriptively communicate the degree of uncertainty in numerical values. Conventionally, low alpha levels (e.g., .05) ensure a high probability of capturing the target value betwee...
Elicitation of normative and fairness judgments: Do incentives matter?
Krupka and Weber (2013) introduce an incentive-compatible coordination game as an alternative method for elicitation of normative judgments. I show, however, that people provide virtually the same responses in incentiviz...