An Application of Gibbs Sampling to Estimation in Meta-Analysis: Accounting for Publication Bias
- 1 June 1997
- journal article
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 22 (2) , 141-154
- https://doi.org/10.3102/10769986022002141
Abstract
There is a widespread concern that published results in most disciplines are highly biased in favor of statistically significant outcomes. We propose a model to explicitly account for publication bias using a weight function that describes the probability of publication for a particular study in terms of a selection parameter. A Bayesian analysis of this model using flat priors on both the parameter of interest and the selection parameter is carried out using Gibbs sampling to calculate the posterior distributions of interest. The model is studied in detail for the case of a single observed result and then extended to provide a method for interpreting meta-analyses. We consider models in which the probability of publication for a study might depend on other characteristics of the study—in particular, the size of the study. Finally, we apply our model to a published meta-analysis which examined the effect of coaching on scores on the SAT.Keywords
This publication has 9 references indexed in Scilit:
- Inference from Iterative Simulation Using Multiple SequencesStatistical Science, 1992
- Explaining the Gibbs SamplerThe American Statistician, 1992
- Modeling Publication Selection Effects in Meta-AnalysisStatistical Science, 1992
- An Approach for Assessing Publication Bias Prior to Performing a Meta-AnalysisStatistical Science, 1992
- Sampling-Based Approaches to Calculating Marginal DensitiesJournal of the American Statistical Association, 1990
- An Assessment of Publication Bias Using a Sample of Published Clinical TrialsJournal of the American Statistical Association, 1989
- Selection Models and the File Drawer ProblemStatistical Science, 1988
- Evaluating the Effect of Coaching on SAT Scores: A Meta-AnalysisHarvard Educational Review, 1983
- Equation of State Calculations by Fast Computing MachinesThe Journal of Chemical Physics, 1953