Is there evidence of publication biases in JDM research?
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
It is a long known problem that the preferential publication of statistically significant results (publication bias) may lead to incorrect estimates of the true effects being investigated. Even though other research areas (e.g., medicine, biology) are aware of the problem, and have identified strong publication biases, researchers in judgment and decision making (JDM) largely ignore it. We reanalyzed two current meta-analyses in this area. Both showed evidence of publication biases that may have led to a substantial overestimation of the true effects they investigated. A review of additional JDM meta-analyses shows that most meta-analyses conducted no or insufficient analyses of publication bias. However, given our results and the rareness of non-significant effects in the literature, we suspect that biases occur quite often. These findings suggest that (a) conclusions based on meta-analyses without reported tests of publication bias should be interpreted with caution and (b) publication policies and standard research practices should be revised to overcome the problem.
Authors and Affiliations
Frank Renkewitz, Heather M. Fuchs and Susann Fiedler
Keywords
Related Articles
- EP ID EP677869
- DOI -
- Views 126
- Downloads 0
The effects of surrounding positive and negative experiences on risk taking
Two experiments explored how the context of recently experiencing an abundance of positive or negative outcomes within a series of choices influences risk preferences. In each experiment, choices were made between a seri...
Anticipatory stress interferes with utilitarian moral judgment
A recent study indicates that acute stress affects moral decision making (Youssef et al., in press). The current study examines whether results can be replicated using a different kind of stressor and a different kind of...
Is a picture worth a thousand words? The interaction of visual display and attribute representation in attenuating framing bias
The attribute framing bias is a well-established phenomenon, in which an object or an event is evaluated more favorably when presented in a positive frame such as “the half full glass” than when presented in the compleme...
What's bad is easy: Taboo values, affect, and cognition
Some decision situations are so objectionable or repugnant that people refuse to make a choice. This paper seeks to better understand taboo responses, and to distinguish choices that are truly taboo from those that are m...
Cue integration vs. exemplar-based reasoning in multi-attribute decisions from memory: A matter of cue representation
Inferences about target variables can be achieved by deliberate integration of probabilistic cues or by retrieving similar cue-patterns (exemplars) from memory. In tasks with cue information presented in on-screen displa...