On the appropriateness of appropriateness judgments: The case of interferon treatment for melanoma
Journal Title: Judgment and Decision Making - Year 2007, Vol 2, Issue 1
Abstract
We compare experts' judgments of the appropriateness of a treatment (interferon treatment for melanoma) on the basis of important attributes of this disease (thickness, ulceration, lymph node involvement and type of metastases) to a decision analytic model in which the probabilities of deterioration are derived from the medical literature and from epidemiological studies. The comparison is based on what we call the linearity test, which examines whether appropriateness judgments are a linear function of the epidemiological value of p2, the probability of deterioration of the patient condition if he would have received the treatment. This comparison allows for the assessment of the validity of the experts' judgments under the assumption that the decision analytic model is valid, or alternatively, the assessment of the validity of the decision analytic model under the assumption that the experts' judgments are valid. Under the former assumption the results indicate that appropriateness judgments are by and large accurate. Under the latter assumption the results support the idea of a constant treatment effect, the idea that efficacy of a treatment is constant over various levels of severity of the disease. Our results also support the idea that experts' aggregate judgments far exceed individuals' judgments.
Authors and Affiliations
Yoav Ganzach and Moshe Leshno
Comparative evaluation of the forecast accuracy of analysis reports and a prediction market
This paper summarizes an empirical comparison of the accuracy of forecasts included in analysis reports developed by professional intelligence analysts to comparable forecasts in a prediction market that has broad partic...
Self-reported ethical risk taking tendencies predict actual dishonesty
Are people honest about the extent to which they engage in unethical behaviors? We report an experiment examining the relation between self-reported risky unethical tendencies and actual dishonest behavior. Participants’...
Leftmost-digit-bias in an enumerated public sector? An experiment on citizens’ judgment of performance information
Numerical performance information is increasingly important to political decision-making in the public sector. Some have suggested that biases in citizens’ processing of numerical information can be exploited by politici...
Are maximizers really unhappy? The measurement of maximizing tendency
Recent research suggesting that people who maximize are less happy than those who satisfice has received considerable fanfare. The current study investigates whether this conclusion reflects the construct itself or rathe...
Semantic cross-scale numerical anchoring
Anchoring effects are robust, varied and can be consequential. Researchers have provided a variety of alternative explanations for these effects. More recently, it has become apparent that anchoring effects might be prod...