Publication Bias: The Problem That Won't Go Away
- 17 December 1993
- journal article
- research article
- Published by Wiley in Annals of the New York Academy of Sciences
- Vol. 703 (1) , 135-148
- https://doi.org/10.1111/j.1749-6632.1993.tb26343.x
Abstract
Conclusions about the efficacy and safety of medical interventions are based on data presented in the scientific literature. The validity of these conclusions is threatened if publication bias results from investigators or editors making decisions about publishing study results on the basis of the direction or strength of the study findings. This paper reports meta-analyses performed using data from four prospective investigations in which a total of 997 initiated studies were followed to learn of study results, publication status, and reasons for nonpublication. The analysis indicates that there is a positive association between "significant" study results and publication (OR = 2.88; 95% confidence interval [CI] 2.13 to 3.90). When the analysis was restricted to controlled trials (n = 280), an even stronger relationship between "significant" results and publication was observed (OR = 6.15; 95% CI 2.24 to 16.92), with randomized trials (n = 200) apparently no less susceptible to publication bias than controlled trials in general (OR = 8.72; 95% CI 1.91 to 39.81). In every case, failure to publish was investigator-based, and not due to editorial decisions. The results of clinical trials should not be suppressed in this way. Development of registration systems for randomized trials is essential if this problem is to be minimized in future.Keywords
This publication has 23 references indexed in Scilit:
- Getting to grips with Archie Cochrane's agenda.BMJ, 1992
- Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boardsJAMA, 1992
- Bias against negative studies in newspaper reports of medical researchPublished by American Medical Association (AMA) ,1991
- New Journal Will Publish Without PaperScience, 1991
- Publication bias in clinical researchThe Lancet, 1991
- The existence of publication bias and risk factors for its occurrenceJAMA, 1990
- BIAS AGAINST THE NULL HYPOTHESIS: THE REPRODUCTIVE HAZARDS OF COCAINEThe Lancet, 1989
- Publication Bias: A Problem in Interpreting Medical DataJournal of the Royal Statistical Society Series A: Statistics in Society, 1988
- Publication Decisions and Their Possible Effects on Inferences Drawn from Tests of Significance--Or Vice VersaJournal of the American Statistical Association, 1959