Misleading Evidence and Evidence-Led Policy: Making Social Science more Experimental
- 1 September 2003
- journal article
- other
- Published by SAGE Publications in The Annals of the American Academy of Political and Social Science
- Vol. 589 (1) , 6-19
- https://doi.org/10.1177/0002716203256266
Abstract
Increasing demands by government for “evidence-led” policy raise the risk that research evidence will mislead government rather than leading to an unbiased conclusion. The need for unbiased research conclusions has never been greater, yet few consumers of research understand the statistical biases with which science must always struggle. This article introduces the volume's discussion of those issues with an explanation of the major threats of bias in social science research and a map of the differing scientific opinions on how to deal with those threats. The thesis of the volume is that many of these threats could be reduced by making social science more experimental. The fact that even experimental evidence contains threats of bias does not alter that claim but merely suggests another: that educated consumers of social science may be the best defense against misleading evidence of all kinds.Keywords
This publication has 11 references indexed in Scilit:
- British Randomized Experiments on Crime and JusticeThe Annals of the American Academy of Political and Social Science, 2003
- Populating an International Web-Based Randomized Trials Register in the Social, Behavioral, Criminological, and Education SciencesThe Annals of the American Academy of Political and Social Science, 2003
- Spinal Manipulative Therapy for Low Back PainAnnals of Internal Medicine, 2003
- The “science” of drug and alcohol prevention: the case of the randomized trial of the Life Skills Training programInternational Journal of Drug Policy, 2002
- The Effects of Canvassing, Telephone Calls, and Direct Mail on Voter Turnout: A Field ExperimentAmerican Political Science Review, 2000
- BIASES IN THE INTERPRETATION AND USE OF RESEARCH RESULTSAnnual Review of Psychology, 1998
- Identification of Causal Effects Using Instrumental VariablesJournal of the American Statistical Association, 1996
- Why do we need systematic overviews of randomized trials? (Transcript of an oral presentation, modified by the editors)Statistics in Medicine, 1987
- Design and analysis of randomized clinical trials requiring prolonged observation of each patient. II. Analysis and examplesBritish Journal of Cancer, 1977
- Streptomycin Treatment of Pulmonary Tuberculosis: A Medical Research Council InvestigationBMJ, 1948