How to — and How Not to — Evaluate Innovation
- 1 January 2002
- journal article
- research article
- Published by SAGE Publications in Evaluation
- Vol. 8 (1) , 13-28
- https://doi.org/10.1177/1358902002008001514
Abstract
Many traditional evaluation methods, including most performance measurement approaches, inhibit rather than support actual innovation. This article discusses the nature of innovation, identifies limitations of traditional evaluation approaches for assessing innovation and proposes an alternative model of evaluation consistent with the nature of innovation. Most attempts at innovation, by definition, are risky and should `fail' — otherwise they are using safe, rather than unknown or truly innovative approaches. A few key impacts by a minority of projects or participants may be much more meaningful than changes in mean (or average) scores. Yet the most common measure of programme impact is the mean. In contrast, this article suggests that evaluation of innovation should identify the minority of situations where real impact has occurred and the reasons for this. This is in keeping with the approach venture capitalists typically take where they expect most of their investments to `fail', but to be compensated by major gains on just a few.Keywords
This publication has 10 references indexed in Scilit:
- Cluster EvaluationPublished by SAGE Publications ,2014
- The Interface between Evaluation and Public PolicyEvaluation, 1999
- Evaluation Research and the Performance Management Movement: From Estrangement to Useful Integration?Evaluation, 1999
- The Inequality of Performance MeasurementsEvaluation, 1999
- Evaluation and Performance Management in GovernmentEvaluation, 1999
- Effective Use and Misuse of Performance MeasurementAmerican Journal of Evaluation, 1998
- Issues in the Evaluation of Innovation and Technology PolicyEvaluation, 1998
- Measuring R&D Effectiveness—IIResearch-Technology Management, 1994
- Measuring R&D Effectiveness—IResearch-Technology Management, 1994
- Reforms as experiments.American Psychologist, 1969