The effect of correlation structure on treatment contrasts estimated from incomplete clinical trial data with likelihood-based repeated measures compared with last observation carried forward ANOVA
- 1 December 2004
- journal article
- research article
- Published by SAGE Publications in Clinical Trials
- Vol. 1 (6) , 477-489
- https://doi.org/10.1191/1740774504cn049oa
Abstract
Valid analyses of longitudinal data can be problematic, particularly when subjects dropout prior to completing the trial for reasons related to the outcome. Regulatory agencies often favor the last observation carried forward (LOCF) approach for imputing missing values in the primary analysis of clinical trials. However, recent evidence suggests that likelihood-based analyses developed under the missing at random framework provide viable alternatives. The within-subject error correlation structure is often the means by which such methods account for the bias from missing data. The objective of this study was to extend previous work that used only one correlation structure by including several common correlation structures in order to assess the effect of the correlation structure in the data, and how it is modeled, on Type I error rates and power from a likelihood-based repeated measures analysis (MMRM), using LOCF for comparison. Data from four realistic clinical trial scenarios were simulated using autoregressive, compound symmetric and unstructured correlation structures. When the correct correlation structure was fit, MMRM provided better control of Type I error and power than LOCF. Although misfitting the correlation structure in MMRM inflated Type I error and altered power, misfitting the structure was typically less deleterious than using LOCF. In fact, simply specifying an unstructured matrix for use in MMRM, regardless of the true correlation structure, yielded superior control of Type I error than LOCF in every scenario. The present and previous investigations have shown that the bias in LOCF is influenced by several factors and interactions between them. Hence, it is difficult to precisely anticipate the direction and magnitude of bias from LOCF in practical situations. However, in scenarios where the overall tendency is for patient improvement, LOCF tends to: 1) overestimate a drug's advantage when dropout is higher in the comparator and underestimate the advantage when dropout is lower in the comparator; 2) overestimate a drug's advantage when the advantage is maximum at intermediate time points and underestimate the advantage when the advantage increases over time; and 3) have a greater likelihood of overestimating a drug's advantage when the advantage is small. In scenarios in which the overall tendency is for patient worsening, the above biases are reversed. In the simulation scenarios considered in this study, which were patterned after acute phase neuropsychiatric clinical trials, the likelihood-based repeated measures approach, implemented with standard software, was more robust to the bias from missing data than LOCF, and choice of correlation structure was not an impediment to its implementation.Keywords
This publication has 28 references indexed in Scilit:
- Analyzing incomplete longitudinal clinical trial dataBiostatistics, 2004
- Type I Error Rates from Mixed Effects Model Repeated Measures Versus Fixed Effects Anova with Missing Values Imputed Via Last Observation Carried ForwardDrug Information Journal, 2001
- ACCOUNTING FOR DROPOUT BIAS USING MIXED-EFFECTS MODELSJournal of Biopharmaceutical Statistics, 2001
- A comparison of the random-effects pattern mixture model with last-observation-carried-forward(locf) analysis in longitudinal clinical trials with dropoutsJournal of Biopharmaceutical Statistics, 1998
- A multiple imputation strategy for clinical trials with truncation of patient dataStatistics in Medicine, 1995
- Informative Drop-Out in Longitudinal Data AnalysisJournal of the Royal Statistical Society Series C: Applied Statistics, 1994
- Some Conceptual and Statistical Issues in Analysis of Longitudinal Psychiatric DataArchives of General Psychiatry, 1993
- Statistical handling of drop‐outs in longitudinal clinical trialsStatistics in Medicine, 1992
- Multiple imputation in health‐are databases: An overview and some applicationsStatistics in Medicine, 1991
- Missing data in longitudinal studiesStatistics in Medicine, 1988