Tailored proper scoring rules elicit decision weights
Journal Title: Judgment and Decision Making - Year 2015, Vol 10, Issue 1
Abstract
Proper scoring rules are scoring methods that incentivize honest reporting of subjective probabilities, where an agent strictly maximizes his expected score by reporting his true belief. The implicit assumption behind proper scoring rules is that agents are risk neutral. Such an assumption is often unrealistic when agents are human beings. Modern theories of choice under uncertainty based on rank-dependent utilities assert that human beings weight nonlinear utilities using decision weights, which are differences between weighting functions applied to cumulative probabilities. In this paper, I investigate the reporting behavior of an agent with a rank-dependent utility when he is rewarded using a proper scoring rule tailored to his utility function. I show that such an agent misreports his true belief by reporting a vector of decision weights. My findings thus highlight the risk of utilizing proper scoring rules without prior knowledge about all the components that drive an agent’s attitude towards uncertainty. On the positive side, I discuss how tailored proper scoring rules can effectively elicit weighting functions. Moreover, I show how to obtain an agent’s true belief from his misreported belief once the weighting functions are known.
Authors and Affiliations
Arthur Carvalho
Keywords
Related Articles
- EP ID EP678161
- DOI -
- Views 150
- Downloads 0
Identifying decision strategies in a consumer choice situation
In two studies on mobile phone purchase decisions, we investigated consumers’ decision strategies with a newly developed process tracing tool called InterActive Process Tracing (IAPT). This tool is a combination of sever...
Using hierarchical Bayesian methods to examine the tools of decision-making
Hierarchical Bayesian methods offer a principled and comprehensive way to relate psychological models to data. Here we use them to model the patterns of information search, stopping and deciding in a simulated binary com...
Effects of ignorance and information on judgments and decisions
We compared Turkish and English students’ soccer forecasting for English soccer matches. Although the Turkish students knew very little about English soccer, they selected teams on the basis of familiarity with the team...
Decision making in civil disputes: The effects of legal role, frame, and perceived chance of winning
The present study investigates the effect of framing and legal role on the propensity to accept a settlement offer by litigants in a simulated legal dispute. Participants were given four different scenarios that factoria...
Metacognitive judgment and denial of deficit: Evidence from frontotemporal dementia
Patients suffering from the behavioral variant of Frontotemporal Dementia (FTD-b) often exaggerate their abilities. Are those errors in judgment limited to domains in which patients under-perform, or do FTD-b patients ov...