Assessing heterogeneity in meta-analysis: Q statistic or I² index?
Top Cited Papers
- 1 January 2006
- journal article
- research article
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 11 (2) , 193-206
- https://doi.org/10.1037/1082-989x.11.2.193
Abstract
In meta-analysis, the usual way of assessing whether a set of single studies is homogeneous is by means of the Q test. However, the Q test only informs meta-analysts about the presence versus the absence of heterogeneity, but it does not report on the extent of such heterogeneity. Recently, the 12 index has been proposed to quantify the degree of heterogeneity in a meta-analysis. In this article, the performances of the Q test and the confidence interval around the 12 index are compared by means of a Monte Carlo simulation. The results show the utility of the 12 index as a complement to the Q test, although it has the same problems of power with a small number of studies.Keywords
Funding Information
- Ministerio de Educacion y Ciencia
- Fondo Europeo de Desarrollo Regional (SEJ2004-07278/PSIC)
This publication has 41 references indexed in Scilit:
- Measuring inconsistency in meta-analysesBMJ, 2003
- Quantifying heterogeneity in a meta‐analysisStatistics in Medicine, 2002
- The Efficacy of Two Improvement-Over-Chance Effect Sizes for Two-Group Univariate Comparisons Under Variance Heterogeneity and NonnormalityEducational and Psychological Measurement, 2001
- Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed- and random-effects methods.Psychological Methods, 2001
- The influence of treatment programmes on the recidivism of juvenile and adult offenders: An european meta-analytic reviewPsychology, Crime & Law, 1999
- An empirical study of Hedge's homogeneity test.Psychological Methods, 1997
- Statistical and empirical examination of the chi-square test for homogeneity of correlations in meta-analysis.Psychological Bulletin, 1989
- Meta-analysis in clinical trialsControlled Clinical Trials, 1986
- On seeking moderator variables in the meta-analysis of correlational data: A Monte Carlo investigation of statistical power and resistance to Type I error.Journal of Applied Psychology, 1986
- Statistical power of tests of the situational specificity hypothesis in validity generalization studies: A cautionary note.Journal of Applied Psychology, 1983