Does Research Design Affect Study Outcomes in Criminal Justice?
- 1 November 2001
- journal article
- research article
- Published by SAGE Publications in The Annals of the American Academy of Political and Social Science
- Vol. 578 (1) , 50-70
- https://doi.org/10.1177/000271620157800104
Abstract
Does the type of research design used in a crime and justice study influence its conclusions? Scholars agree in theory that randomized experimental studies have higher internal validity than do nonrandomized studies. But there is not consensus regarding the costs of using nonrandomized studies in coming to conclusions regarding criminal justice interventions. To examine these issues, the authors look at the relationship between research design and study outcomes in a broad review of research evidence on crime and justice commissioned by the National Institute of Justice. Their findings suggest that design does have a systematic effect on outcomes in criminal justice studies. The weaker a design, indicated by internal validity, the more likely a study is to report a result in favor of treatment and the less likely it is to report a harmful effect of treatment. Even when comparing randomized studies with strong quasi-experimental research designs, systematic and statistically significant differences are observed.Keywords
This publication has 21 references indexed in Scilit:
- Published by SAGE Publications ,2001
- Lessons from Two Randomized Experiments in Criminal Justice SettingsCrime & Delinquency, 2000
- The Need for Experiments in Criminal Justice SettingsCrime & Delinquency, 2000
- The Importance of Randomized Field TrialsCrime & Delinquency, 2000
- What is Evidence-based Education?British Journal of Educational Studies, 1999
- meta-analysis bias in location and selection of studiesBMJ, 1998
- The Case for Randomized Field Trials in Economic and Policy ResearchJournal of Economic Perspectives, 1995
- A Meta-Analytic Assessment of Delinquency-Related Outcomes of Alternative Education ProgramsCrime & Delinquency, 1995
- Randomized Experiments on Crime and JusticeCrime and Justice, 1983
- Correctional Outcome: An Evaluation of 100 ReportsThe Journal of Criminal Law, Criminology, and Police Science, 1966