Survey of the Quality of Experimental Design, Statistical Analysis and Reporting of Research Using Animals
Top Cited Papers
Open Access
- 30 November 2009
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 4 (11) , e7824
- https://doi.org/10.1371/journal.pone.0007824
Abstract
For scientific, ethical and economic reasons, experiments involving animals should be appropriately designed, correctly analysed and transparently reported. This increases the scientific validity of the results, and maximises the knowledge gained from each experiment. A minimum amount of relevant information must be included in scientific publications to ensure that the methods and results of a study can be reviewed, analysed and repeated. Omitting essential information can raise scientific and ethical concerns. We report the findings of a systematic survey of reporting, experimental design and statistical analysis in published biomedical research using laboratory animals. Medline and EMBASE were searched for studies reporting research on live rats, mice and non-human primates carried out in UK and US publicly funded research establishments. Detailed information was collected from 271 publications, about the objective or hypothesis of the study, the number, sex, age and/or weight of animals used, and experimental and statistical methods. Only 59% of the studies stated the hypothesis or objective of the study and the number and characteristics of the animals used. Appropriate and efficient experimental design is a critical component of high-quality science. Most of the papers surveyed did not use randomisation (87%) or blinding (86%), to reduce bias in animal selection and outcome assessment. Only 70% of the publications that used statistical methods described their methods and presented the results with a measure of error or variability. This survey has identified a number of issues that need to be addressed in order to improve experimental design and reporting in publications describing research using animals. Scientific publication is a powerful and important source of information; the authors of scientific publications therefore have a responsibility to describe their methods and results comprehensively, accurately and transparently, and peer reviewers and journal editors share the responsibility to ensure that published studies fulfil these criteria.Keywords
This publication has 28 references indexed in Scilit:
- Evidence for the Efficacy of NXY-059 in Experimental Focal Cerebral Ischaemia Is Confounded by Study QualityStroke, 2008
- Do in vivo Experimental Models Reflect Human Cerebral Small Vessel Disease? a Systematic ReviewJournal of Cerebral Blood Flow & Metabolism, 2008
- Effect size, confidence interval and statistical significance: a practical guide for biologistsBiological Reviews, 2007
- A Systematic Review of Systematic Reviews and Meta-Analyses of Animal Experiments with Guidelines for ReportingJournal of Environmental Science and Health, Part B, 2006
- Quality of Reporting of Observational Longitudinal ResearchAmerican Journal of Epidemiology, 2005
- Specification of laboratory animal use in scientific articles: Current low detail in the journals' instructions for authors and some proposalsMethods and Findings in Experimental and Clinical Pharmacology, 2005
- Assessment of ecological effects due to forest harvesting: approaches and statistical issuesJournal of Applied Ecology, 2004
- Microbial Biodiversity: Approaches to Experimental Design and Hypothesis Testing in Primary Scientific Literature from 1975 to 1999Microbiology and Molecular Biology Reviews, 2002
- Assessment of statistical procedures used in papers in the Australian Veterinary JournalAustralian Veterinary Journal, 1995
- The History of the Measurement of III healthInternational Journal of Epidemiology, 1972