The Fairy Godmother—and Her Warts
- 1 March 2008
- journal article
- Published by SAGE Publications in American Journal of Evaluation
- Vol. 29 (1) , 29-47
- https://doi.org/10.1177/1098214007313742
Abstract
Evaluators sometimes wish for a Fairy Godmother who would make decision makers pay attention to evaluation findings when choosing programs to implement. The U.S. Department of Education came close to creating such a Fairy Godmother when it required school districts to choose drug abuse prevention programs only if their effectiveness was supported by “scientific” evidence. The experience showed advantages of such a procedure (e.g., reduction in support for D.A.R.E., which evaluation had found wanting) but also shortcomings (limited and in some cases questionable evaluation evidence in support of other programs). Federal procedures for identifying successful programs appeared biased. In addition, the Fairy Godmother discounted the professional judgment of local educators and did little to improve the fit of programs to local conditions. Nevertheless, giving evaluation more clout is a worthwhile way to increase the rationality of decision making. The authors recommend research on procedures used by other agencies to achieve similar aims.Keywords
This publication has 38 references indexed in Scilit:
- US state government and DARE: the story in four statesEvidence & Policy, 2006
- Linking research and policy on Capitol Hill: insights from research brokersEvidence & Policy, 2005
- Problems of Evidence Based Practice in Community Based ServicesJournal of Learning Disabilities, 2004
- Misleading Evidence and Evidence-Led Policy: Making Social Science more ExperimentalThe Annals of the American Academy of Political and Social Science, 2003
- Standards for Evidence and Evidence for Standards: The Case of School-Based Drug PreventionThe Annals of the American Academy of Political and Social Science, 2003
- Meta-Analysis: Recent Developments in Quantitative Methods for Literature ReviewsAnnual Review of Psychology, 2001
- The dissemination and utilization of welfare-to-work experiments in state policymakingJournal of Policy Analysis and Management, 2000
- Congressional Committees as Users of AnalysisJournal of Policy Analysis and Management, 1989
- Current Empirical Research on Evaluation UtilizationReview of Educational Research, 1986
- The Utilization Process: A Conceptual Framework and Synthesis of Empirical FindingsAdministrative Science Quarterly, 1982