A Procedure for Assessing Intervention Fidelity in Experiments Testing Educational and Behavioral Interventions
- 31 August 2012
- journal article
- research article
- Published by Springer Nature in The Journal of Behavioral Health Services & Research
- Vol. 39 (4) , 374-396
- https://doi.org/10.1007/s11414-012-9295-x
Abstract
An intervention's effectiveness is judged by whether it produces positive outcomes for participants, with the randomized experiment being the gold standard for determining intervention effects. However, the intervention-as-implemented in an experiment frequently differs from the intervention-as-designed, making it unclear whether unfavorable results are due to an ineffective intervention model or the failure to implement the model fully. It is therefore vital to accurately and systematically assess intervention fidelity and, where possible, incorporate fidelity data in the analysis of outcomes. This paper elaborates a five-step procedure for systematically assessing intervention fidelity in the context of randomized controlled trials (RCTs), describes the advantages of assessing fidelity with this approach, and uses examples to illustrate how this procedure can be applied.This publication has 36 references indexed in Scilit:
- Toward the Effective and Efficient Measurement of Implementation FidelityAdministration and Policy in Mental Health and Mental Health Services Research, 2010
- Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting ImplementationAmerican Journal of Community Psychology, 2008
- A conceptual framework for implementation fidelityImplementation Science, 2007
- The effects of school-based intervention programs on aggressive behavior: A meta-analysis.Journal of Consulting and Clinical Psychology, 2003
- A School, Family, and Community Collaborative Program for Children Who Have Emotional DisturbancesJournal of Emotional and Behavioral Disorders, 2002
- Putting Program Theory into OperationAmerican Journal of Evaluation, 1999
- Increased Knowledge in Geometry and Instructional PracticeJournal for Research in Mathematics Education, 1997
- Statistics and Causal InferenceJournal of the American Statistical Association, 1986
- Assumptions Underlying the Use of Content ValidityEducational and Psychological Measurement, 1956
- Coefficient alpha and the internal structure of testsPsychometrika, 1951