Statistical Comparison of ROC Curves from Multiple Readers
- 1 June 1996
- journal article
- research article
- Published by SAGE Publications in Medical Decision Making
- Vol. 16 (2) , 143-152
- https://doi.org/10.1177/0272989x9601600206
Abstract
Receiver operating characteristic (ROC) analysis is the commonly accepted method for comparing diagnostic imaging systems. In general, ROC studies are designed in such a way that multiple readers read the same images and each image is presented by means of two different imaging systems. Statistical methods for the comparison of the ROC curves from one reader have been developed, but extension of these meth ods to multiple readers is not straightforward. A new method of analysis is presented for the comparison of ROC curves from multiple readers. This method includes a non parametric estimation of the variances and covariances between the various areas under the curves. The method described is more appropriate than the paired t test, because it also takes the case-sample variation into account. Key words: ROC curves; ROC analysis; nonparametric estimation; area under the curve; comparison of ROC curves; EM algorithm. (Med Decis Making 1996;16:143-152)Keywords
This publication has 10 references indexed in Scilit:
- Confidence Bands for Receiver Operating Characteristic CurvesMedical Decision Making, 1993
- Receiver Operating Characteristic Rating AnalysisInvestigative Radiology, 1992
- Some Practical Issues of Experimental Design and Data Analysis in Radiological ROC StudiesInvestigative Radiology, 1989
- Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric ApproachPublished by JSTOR ,1988
- ROC Methodology in Radiologic ImagingInvestigative Radiology, 1986
- A method of comparing the areas under receiver operating characteristic curves derived from the same cases.Radiology, 1983
- The meaning and use of the area under a receiver operating characteristic (ROC) curve.Radiology, 1982
- Basic principles of ROC analysisSeminars in Nuclear Medicine, 1978
- Maximum Likelihood from Incomplete Data Via the EM AlgorithmJournal of the Royal Statistical Society Series B: Statistical Methodology, 1977