Confirmatory Program Evaluation: A Method for Strengthening Causal Inference
- 1 June 1998
- journal article
- Published by SAGE Publications in American Journal of Evaluation
- Vol. 19 (2) , 203-221
- https://doi.org/10.1177/109821409801900204
Abstract
This paper discusses current issues in theory-driven evaluation from the perspective of the evaluation practice literature. Applications of theory-driven approaches are not easily found, in part, because there are few procedures for conducting them. I offer confirmatory program evaluation as one way to use theory, in combination with quantitative analytical techniques, to assess the effects of social and educational programs. In contrast to many other approaches, theory-driven evaluation generally emphasizes the explication and testing of a priori program theories in determining effectiveness. Confirmatory program evaluation is an impact assessment that examines the pattern of empirical findings against several causal criteria, including temporality, size, gradient (dosage/response), specificity, consistency, and coherence of the program-outcome relationship. A special emphasis is given to identifying causal mechanisms or active ingredients of programs that yield effects. An illustration of confirmatory program evaluation is provided for a child development intervention called the Child Parent Center Program. The limitations of this method are discussed, as well as the conditions under which it is most useful.Keywords
This publication has 26 references indexed in Scilit:
- A continuum of care: More is not always better.American Psychologist, 1996
- Cognitive and Family-Support Mediators of Preschool Effectiveness: A Confirmatory AnalysisChild Development, 1996
- Quasi-Experimental Estimates of the Effects of a Preschool InterventionEvaluation Review, 1995
- The functions of program theoryNew Directions for Program Evaluation, 1987
- Efficacy of Early InterventionThe Journal of Special Education, 1985
- Pattern Matching, Validity, and Conceptualization in Program EvaluationEvaluation Review, 1985
- Evaluation: The state of the art and the sorry state of the scienceNew Directions for Program Evaluation, 1985
- From Association to Causation in Observational Studies: The Role of Tests of Strongly Ignorable Treatment AssignmentJournal of the American Statistical Association, 1984
- Evaluating Educational Programs: An Integrative, Causal-modeling ApproachEducational Evaluation and Policy Analysis, 1983
- Pertinency of an extraneous variableJournal of Chronic Diseases, 1967