Information search with situation-specific reward functions
Journal Title: Judgment and Decision Making - Year 2012, Vol 7, Issue 2
Abstract
The goal of obtaining information to improve classification accuracy can strongly conflict with the goal of obtaining information for improving payoffs. Two environments with such a conflict were identified through computer optimization. Three subsequent experiments investigated people’s search behavior in these environments. Experiments 1 and 2 used a multiple-cue probabilistic category-learning task to convey environmental probabilities. In a subsequent search task subjects could query only a single feature before making a classification decision. The crucial manipulation concerned the search-task reward structure. The payoffs corresponded either to accuracy, with equal rewards associated with the two categories, or to an asymmetric payoff function, with different rewards associated with each category. In Experiment 1, in which learning-task feedback corresponded to the true category, people later preferentially searched the accuracy-maximizing feature, whether or not this would improve monetary rewards. In Experiment 2, an asymmetric reward structure was used during learning. Subjects searched the reward-maximizing feature when asymmetric payoffs were preserved in the search task. However, if search-task payoffs corresponded to accuracy, subjects preferentially searched a feature that was suboptimal for reward and accuracy alike. Importantly, this feature would have been most useful, under the learning-task payoff structure. Experiment 3 found that, if words and numbers are used to convey environmental probabilities, neither reward nor accuracy consistently predicts search. These findings emphasize the necessity of taking into account people’s goals and search-and-decision processes during learning, thereby challenging current models of information search.
Authors and Affiliations
Björn Meder and Jonathan D. Nelson
Keywords
Related Articles
- EP ID EP677879
- DOI -
- Views 148
- Downloads 0
Atypical moral judgment following traumatic brain injury
Previous research has shown an association between emotions, particularly social emotions, and moral judgments. Some studies suggested an association between blunted emotion and the utilitarian moral judgments observed i...
Observing others’ behavior and risk taking in decisions from experience
This paper examines how observing other people’s behavior affects risk taking in repeated decision tasks. In Study 1, 100 participants performed experience-based decision tasks either alone or in pairs, with the two memb...
Strategies using recent feedback lead to matching or maximising behaviours
One challenge facing humans (and nonhuman animal) is that some options that appear attractive locally may not turn out best in the long run. To analyse this human learning problem, we explore human performance in a dynam...
Coherence and correspondence in the psychological analysis of numerical predictions: How error-prone heuristics are replaced by ecologically valid heuristics
Numerical predictions are of central interest for both coherence-based approaches to judgment and decisions — the Heuristic and Biases (HB) program in particular — and to correspondence-based approaches — Social Judgment...
Gender Differences in Risk Assessment: Why do Women Take Fewer Risks than Men?
Across many real-world domains, men engage in more risky behaviors than do women. To examine some of the beliefs and preferences that underlie this difference, 657 participants assessed their likelihood of engaging in va...