The impact of missing data and how it is handled on the rate of false‐positive results in drug development
- 12 September 2007
- journal article
- research article
- Published by Wiley in Pharmaceutical Statistics
- Vol. 7 (3) , 215-225
- https://doi.org/10.1002/pst.310
Abstract
In drug development, a common choice for the primary analysis is to assess mean changes via analysis of (co)variance with missing data imputed by carrying the last or baseline observations forward (LOCF, BOCF). These approaches assume that data are missing completely at random (MCAR). Multiple imputation (MI) and likelihood‐based repeated measures (MMRM) are less restrictive as they assume data are missing at random (MAR). Nevertheless, LOCF and BOCF remain popular, perhaps because it is thought that the bias in these methods lead to protection against falsely concluding that a drug is more effective than the control. We conducted a simulation study that compared the rate of false positive results or regulatory risk error (RRE) from BOCF, LOCF, MI, and MMRM in 32 scenarios that were generated from a 25 full factorial arrangement with data missing due to a missing not at random (MNAR) mechanism. Both BOCF and LOCF inflated RRE were compared to MI and MMRM. In 12 of the 32 scenarios, BOCF yielded inflated RRE compared with eight scenarios for LOCF, three scenarios for MI and four scenarios for MMRM. In no situation did BOCF or LOCF provide adequate control of RRE when MI and MMRM did not. Both MI and MMRM are better choices than either BOCF or LOCF for the primary analysis. Copyright © 2007 John Wiley & Sons, Ltd.Keywords
This publication has 26 references indexed in Scilit:
- A Local Influence Sensitivity Analysis for Incomplete Longitudinal Depression DataJournal of Biopharmaceutical Statistics, 2006
- Analyzing incomplete longitudinal clinical trial dataBiostatistics, 2004
- Choice of the primary analysis in longitudinal clinical trialsPharmaceutical Statistics, 2004
- Type I error rates from likelihood‐based repeated measures analyses of incomplete longitudinal dataPharmaceutical Statistics, 2004
- Type I Error Rates from Mixed Effects Model Repeated Measures Versus Fixed Effects Anova with Missing Values Imputed Via Last Observation Carried ForwardDrug Information Journal, 2001
- A comparison of the random-effects pattern mixture model with last-observation-carried-forward(locf) analysis in longitudinal clinical trials with dropoutsJournal of Biopharmaceutical Statistics, 1998
- The analysis of longitudinal ordinal data with nonrandom drop-outBiometrika, 1997
- Handling "Don't Know" Survey Responses: The Case of the Slovenian PlebisciteJournal of the American Statistical Association, 1995
- Statistical handling of drop‐outs in longitudinal clinical trialsStatistics in Medicine, 1992
- Multiple imputation in health‐are databases: An overview and some applicationsStatistics in Medicine, 1991