Strategies for exploration in the domain of losses
Journal Title: Judgment and Decision Making - Year 2017, Vol 12, Issue 2
Abstract
Many decisions in everyday life involve a choice between exploring options that are currently unknown and exploiting options that are already known to be rewarding. Previous work has suggested that humans solve such “explore-exploit” dilemmas using a mixture of two strategies: directed exploration, in which information seeking drives exploration by choice, and random exploration, in which behavioral variability drives exploration by chance. One limitation of this previous work was that, like most studies on explore-exploit decision making, it focused exclusively on the domain of gains, where the goal was to maximize reward. In many real-world decisions, however, the goal is to minimize losses and it is well known from Prospect Theory that behavior can be quite different in this domain. In this study, we compared explore-exploit behavior of human subjects under conditions of gain and loss. We found that people use both directed and random exploration regardless of whether they are exploring to maximize gains or minimize losses and that there is quantitative agreement between the exploration parameters across domains. Our results also revealed an overall bias towards the more uncertain option in the domain of losses. While this bias towards uncertainty was qualitatively consistent with the predictions of Prospect Theory, quantitatively we found that the bias was better described by a Bayesian account, in which subjects had a prior that was optimistic for losses and pessimistic for gains. Taken together, our results suggest that explore-exploit decisions are driven by three independent processes: directed and random exploration, and a baseline uncertainty seeking that is driven by a prior.
Authors and Affiliations
Paul M. Krueger, Robert C. Wilson and Jonathan D. Cohen
Keywords
Related Articles
- EP ID EP678280
- DOI -
- Views 125
- Downloads 0
The effect of perceived advantage and disadvantage on the variability and stability of efficacy beliefs
We examined the effect of perceptions of advantage and disadvantage on the variability and stability of efficacy beliefs in a competition. Perceptions of advantageous or disadvantageous opening position were experimental...
Finding meaning in the clouds: Illusory pattern perception predicts receptivity to pseudo-profound bullshit
Previous research has demonstrated a link between illusory pattern perception and various irrational beliefs. On this basis, we hypothesized that participants who displayed greater degrees of illusory pattern perception...
Four challenges for cognitive research on the recognition heuristic and a call for a research strategy shift
The recognition heuristic assumes that people make inferences based on the output of recognition memory. While much work has been devoted to establishing the recognition heuristic as a viable description of how people ma...
The influence of identifiability and singularity in moral decision making
There is an increased willingness to help identified individuals rather than non-identified, and the effect of identifiability is mainly present when a single individual rather than a group is presented. However, identif...
Ideology, motivated reasoning, and cognitive reflection
Decision scientists have identified various plausible sources of ideological polarization over climate change, gun violence, national security, and like issues that turn on empirical evidence. This paper describes a stud...