Formative Evaluation for Implementation: Evaluating Educational Technology Applications and Lessons
- 1 March 2004
- journal article
- Published by SAGE Publications in American Journal of Evaluation
- Vol. 25 (1) , 51-64
- https://doi.org/10.1177/109821400402500104
Abstract
Educational technology applications and lessons, such as learning modules, activities, and user-authored systems, face substantial implementation challenges in public schools and post-secondary institutions. The design of technology impacts the willingness of teachers to implement new technology; evaluators examining implementation obstacles can help improve design. In this article, both summative and formative implementation evaluation are discussed in non-technology contexts and compared with current practices with educational technology. Formative evaluation has traditionally focused on making applications and lessons “work”; however, many implementation problems are caused by non-technical/interface concerns and related to the compatibility of the technology with its surroundings. An overview of research on implementation of applications and lessons is provided and linked to a model of formative evaluation for implementation in this area. Technical, curricular/instructional, and practical areas of implementation are examined. Common implementation problems and typical design recommendations are presented. The use of the model is discussed in other areas, such as medicine and assistive technology.Keywords
This publication has 15 references indexed in Scilit:
- High Access and Low Use of Technologies in High School Classrooms: Explaining an Apparent ParadoxAmerican Educational Research Journal, 2001
- Evaluating Instructional Technology Implementation in a Higher Education EnvironmentAmerican Journal of Evaluation, 2000
- Addressing first- and second-order barriers to change: Strategies for technology integrationEducational Technology Research and Development, 1999
- Running to catch a moving train: Schools and information technologiesTheory Into Practice, 1998
- Revisioning models of instructional developmentEducational Technology Research and Development, 1997
- A comprehensive typology for program evaluationEvaluation Practice, 1996
- Formative and Process Evaluation of Health Promotion and Disease Prevention ProgramsEvaluation Review, 1993
- Conceptual and methodological issues in evaluating emergent programsEvaluation and Program Planning, 1987
- Learning From Experience: Lessons From Policy ImplementationEducational Evaluation and Policy Analysis, 1987
- Toward a theory of formative program evaluationNew Directions for Adult and Continuing Education, 1984