The role of measurement reliability in clinical trials
- 1 December 2004
- journal article
- research article
- Published by SAGE Publications in Clinical Trials
- Vol. 1 (6) , 553-566
- https://doi.org/10.1191/1740774504cn057oa
Abstract
One of the principal characteristics of an outcome measure in a clinical trial, and any measurement in general, is its reliability. Reliability refers to the reproducibility of the measurement when repeated at random in the same subject or specimen. Reliability is often confused with validity, which refers to the extent to which the variable properly measures the underlying trait of interest. The coefficient of reliability is an estimate of the proportion of all variation that is not due to measurement error and is readily estimated from replicate measurements. The reliability of a measurement determines its maximal correlation or R2 and slope (or effect size) in regression models, its sensitivity and specificity when used for classifications or predictions, and the power of a statistical test employing the measurement. All decline as the reliability of the measure declines. The reliability of a measurement is an important consideration in the choice of the primary outcome measure for a clinical trial and in the choice of measures used for assessment of eligibility and exclusion. Reliability of measures should be assessed and assured by a quality control program based on randomly selected duplicate assessments. Just as the power of a study is reported in a final publication, so also should the reliability of the outcome and eligibility measurements so as to allow the authors to better describe, and readers to better understand, the sources of imprecision in study results, and those who follow to improve the design of future trials.Keywords
This publication has 26 references indexed in Scilit:
- Measurement Error and Misclassification in Statistics and EpidemiologyPublished by Taylor & Francis ,2003
- Measurement reliability and agreement in psychiatryStatistical Methods in Medical Research, 1998
- ANALYSIS OF MULTIVARIATE RELIABILITY STRUCTURES AND THE INDUCED BIAS IN LINEAR MODEL ESTIMATIONStatistics in Medicine, 1996
- Measurement Error in Nonlinear ModelsPublished by Springer Nature ,1995
- Correction of logistic regression relative risk estimates and confidence intervals for systematic within‐person measurement errorStatistics in Medicine, 1989
- Measurement Error ModelsPublished by Wiley ,1987
- Central laboratory quality control in the national cooperative gallstone studyControlled Clinical Trials, 1983
- The Quangle-A Modification of the Cusum ChartJournal of the Royal Statistical Society Series C: Applied Statistics, 1982
- The effects of measurement errors on some multivariate procedures.American Journal of Public Health, 1977
- The Intraclass Correlation Coefficient as a Measure of ReliabilityPsychological Reports, 1966