Is there evidence of publication biases in JDM research?
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
It is a long known problem that the preferential publication of statistically significant results (publication bias) may lead to incorrect estimates of the true effects being investigated. Even though other research areas (e.g., medicine, biology) are aware of the problem, and have identified strong publication biases, researchers in judgment and decision making (JDM) largely ignore it. We reanalyzed two current meta-analyses in this area. Both showed evidence of publication biases that may have led to a substantial overestimation of the true effects they investigated. A review of additional JDM meta-analyses shows that most meta-analyses conducted no or insufficient analyses of publication bias. However, given our results and the rareness of non-significant effects in the literature, we suspect that biases occur quite often. These findings suggest that (a) conclusions based on meta-analyses without reported tests of publication bias should be interpreted with caution and (b) publication policies and standard research practices should be revised to overcome the problem.
Authors and Affiliations
Frank Renkewitz, Heather M. Fuchs and Susann Fiedler
Keywords
Related Articles
- EP ID EP677869
- DOI -
- Views 130
- Downloads 0
Valuing bets and hedges: Implications for the construct of risk preference
Risk attitudes implied by valuations of risk-increasing assets depart markedly from those implied by valuations of risk-reducing assets. For instance, many are unwilling to pay the expected value for a risky asset or for...
The insured victim effect: When and why compensating harm decreases punishment recommendations
An insurance policy may not only affect the consequences for victims but also for perpetrators. In six experiments we find that people recommend milder punishments for perpetrators when the victim was insured, although p...
Semantic cross-scale numerical anchoring
Anchoring effects are robust, varied and can be consequential. Researchers have provided a variety of alternative explanations for these effects. More recently, it has become apparent that anchoring effects might be prod...
Measuring Social Value Orientation
Narrow self-interest is often used as a simplifying assumption when studying people making decisions in social contexts. Nonetheless, people exhibit a wide range of different motivations when choosing unilaterally among...
The power of moral words: Loaded language generates framing effects in the extreme dictator game
Understanding whether preferences are sensitive to the frame has been a major topic of debate in the last decades. For example, several works have explored whether the dictator game in the give frame gives rise to a diff...