Is there evidence of publication biases in JDM research?
Journal Title: Judgment and Decision Making - Year 2011, Vol 6, Issue 8
Abstract
It is a long known problem that the preferential publication of statistically significant results (publication bias) may lead to incorrect estimates of the true effects being investigated. Even though other research areas (e.g., medicine, biology) are aware of the problem, and have identified strong publication biases, researchers in judgment and decision making (JDM) largely ignore it. We reanalyzed two current meta-analyses in this area. Both showed evidence of publication biases that may have led to a substantial overestimation of the true effects they investigated. A review of additional JDM meta-analyses shows that most meta-analyses conducted no or insufficient analyses of publication bias. However, given our results and the rareness of non-significant effects in the literature, we suspect that biases occur quite often. These findings suggest that (a) conclusions based on meta-analyses without reported tests of publication bias should be interpreted with caution and (b) publication policies and standard research practices should be revised to overcome the problem.
Authors and Affiliations
Frank Renkewitz, Heather M. Fuchs and Susann Fiedler
Keywords
Related Articles
- EP ID EP677869
- DOI -
- Views 103
- Downloads 0
How should we think about Americans’ beliefs about economic mobility?
Recent evidence suggests that Americans’ beliefs about upward mobility are overly optimistic. Davidai & Gilovich (2015a), Kraus & Tan (2015), and Kraus (2015) all found that people overestimate the likelihood that a pers...
Relative thinking in consumer choice between differentiated goods and services and its implications for business strategy
The article shows that when people consider differentiated goods or services that differ in price and quality, they exhibit a decision-making bias of “relative thinking”: relative price differences affect them even when...
Identifying decision strategies in a consumer choice situation
In two studies on mobile phone purchase decisions, we investigated consumers’ decision strategies with a newly developed process tracing tool called InterActive Process Tracing (IAPT). This tool is a combination of sever...
Why dyads heed advice less than individuals do
Following up on a recent debate, we examined advice taking in dyads compared to individuals in a set of three studies (total N = 303 dyads and 194 individuals). Our first aim was to test the replicability of an important...
Moderators of framing effects in variations of the Asian Disease problem: Time constraint, need, and disease type
This study examined framing effects in decisions concerning public health. Tversky and Kahneman’s famous Asian Disease Problem served as experimental paradigm. Subjects chose between a sure and a risky option either pres...