Meta-analysis of Comparative Therapy Outcome Research: a Critical Appraisal
- 1 January 1982
- journal article
- review article
- Published by Cambridge University Press (CUP) in Behavioural Psychotherapy
- Vol. 10 (1) , 4-25
- https://doi.org/10.1017/s0141347300006285
Abstract
Meta-analysis is a systematic and quantitative approach to reviewing empirical literature. Its claimed benefits of superior objectivity and dependability arise from its adoption of the methodological principles and methods of primary empirical research. This paper offers a critical appraisal of these claims, with special reference to the application of meta-analysis to the therapy outcome literature. Features examined include the numerical combination of results obtained in independent studies; search procedures and inclusion criteria; and the coding of objective and qualitative features of the source studies, which are then used to study the correlates of outcome via disaggregation and multiple regression analysis. The major criticisms reviewed include allegations of overgeneralization, indiscriminate inclusion of low quality data, and idiosyncratic and unacceptable conclusions. It is concluded that the continued application and refinement of meta-analysis in the field of therapy outcomes has an important contribution to make, although not to the exclusion of other methods of integrating data. It is predicted that methods and principles currently associated with meta-analysis will increasingly find a place in all reviews of extensive tracts of empirical literature.Keywords
This publication has 39 references indexed in Scilit:
- The file drawer problem and tolerance for null results.Psychological Bulletin, 1979
- Box scores are for baseballBehavioral and Brain Sciences, 1978
- On the misuse of statisticsBehavioral and Brain Sciences, 1978
- Combining results of independent studies.Psychological Bulletin, 1978
- Consequences of prejudice against the null hypothesis.Psychological Bulletin, 1975
- Resolving Research Controversy Through Empirical CumulationSociological Methods & Research, 1974
- The test of significance in psychological research.Psychological Bulletin, 1966
- Publication Decisions and Their Possible Effects on Inferences Drawn from Tests of Significance--Or Vice VersaJournal of the American Statistical Association, 1959
- The effects of psychotherapy: an evaluation.Journal of Consulting Psychology, 1952
- The American SoldierBritish Journal of Sociology, 1950