Multidimensional Implementation Evaluation of a Residential Treatment Program for Adolescent Substance Abuse
- 1 March 2005
- journal article
- research article
- Published by SAGE Publications in American Journal of Evaluation
- Vol. 26 (1) , 77-94
- https://doi.org/10.1177/1098214004273183
Abstract
The authors applied contemporary methods from the evaluation literature to measure implementation in a residential treatment program for adolescent substance abuse. A logic model containing two main components was measured. Program structure (adherence to the intended framework of service delivery) was measured using data from daily activity logs completed by program staff. Treatment process, conceptualized as therapeutic milieu, was measured using an adapted version of a scale used to measure implementation in therapeutic communities. In addition, variability in implementation was measured using statistical process control (SPC) procedures. Adolescents completed, on average, 50% of the weekly prescribed services. The milieu of the program was rated by the adolescents as highly therapeutic. Moreover, preliminary psychometrics suggest therapeutic milieu can be measured reliably in adolescents. These two main variables were implemented with consistency across adolescents. These findings are discussed along with implications for evaluation work in similar fields.Keywords
This publication has 33 references indexed in Scilit:
- Formative Evaluation for Implementation: Evaluating Educational Technology Applications and LessonsAmerican Journal of Evaluation, 2004
- Fidelity Criteria: Development, Measurement, and ValidationAmerican Journal of Evaluation, 2003
- Accountability and Performance in Charter Schools in Florida: A Theory-Based EvaluationAmerican Journal of Evaluation, 2003
- Many A Slip Between Cup And LipEvaluation Review, 2003
- On the Importance of Being Earnest about Treatment IntegrityAugmentative and Alternative Communication, 2002
- Assessing program fidelity in substance abuse health services researchAddiction, 2000
- Why Program Implementation is ImportantJournal of Prevention & Intervention in the Community, 1998
- Treatment adherence and differentiation in individual versus family therapy for adolescent substance abuse.Journal of Counseling Psychology, 1998
- Treatment fidelity in outcome studiesClinical Psychology Review, 1991
- Comparisons of Perceptions of the Environments of Adolescent Drug Treatment Residential and Outpatient Programs by Staff versus Clients and by Sex of Staff and ClientsThe American Journal of Drug and Alcohol Abuse, 1986