Time to Update and Quantitative Changes in the Results of Cochrane Pregnancy and Childbirth Reviews
Open Access
- 13 July 2010
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 5 (7) , e11553
- https://doi.org/10.1371/journal.pone.0011553
Abstract
The recommended interval between updates for systematic reviews included in The Cochrane Library is 2 years. However, it is unclear whether this interval is always appropriate. Whereas excessive updating wastes time and resources, insufficient updating allows out-of-date or incomplete evidence to guide clinical decision-making. We set out to determine, for Cochrane pregnancy and childbirth reviews, the frequency of updates, factors associated with updating, and whether updating frequency was appropriate. Cochrane pregnancy and childbirth reviews published in Issue 3, 2007 of the Cochrane Database of Systematic Reviews were retrieved, and data were collected from their original and updated versions. Quantitative changes were determined for one of the primary outcomes (mortality, or the outcome of greatest clinical significance). Potential factors associated with time to update were assessed using the Cox proportional hazard model. Among the 101 reviews in our final sample, the median time before the first update was 3.3 years (95% CI 2.7–3.8). Only 32.7% had been updated within the recommended interval of 2 years. In 75.3% (76/101), a median of 3 new trials with a median of 576 additional participants were included in the updated versions. There were quantitative changes in 71% of the reviews that included new trials (54/76): the median change in effect size was 18.2%, and the median change in 95% CI width was 30.8%. Statistical significance changed in 18.5% (10/54) of these reviews, but conclusions were revised in only 3.7% (2/54). A shorter time to update was associated with the same original review team at updating. Most reviews were updated less frequently than recommended by Cochrane policy, but few updates had revised conclusions. Prescribed time to update should be reconsidered to support improved decision-making while making efficient use of limited resources.Keywords
This publication has 9 references indexed in Scilit:
- How Quickly Do Systematic Reviews Go Out of Date? A Survival AnalysisAnnals of Internal Medicine, 2007
- Epidemiology and Reporting Characteristics of Systematic ReviewsPLoS Medicine, 2007
- Systematic reviews: when is an update an update?The Lancet, 2006
- Investing in updating: how do conclusions change when Cochrane systematic reviews are updated?BMC Medical Research Methodology, 2005
- Publishing Protocols of Systematic ReviewsJAMA, 2002
- Updating a systematic review – what difference did it make? Case study of nicotine replacement therapyBMC Medical Research Methodology, 2001
- Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy.2001
- Systematic Reviews: Reporting, updating, and correcting systematic reviews of the effects of health careBMJ, 1994
- Systematic Reviews: Rationale for systematic reviewsBMJ, 1994