Variability in grading diabetic retinopathy from stereo fundus photographs: comparison of physician and lay readers.
Open Access
- 1 March 1977
- journal article
- research article
- Published by BMJ in British Journal of Ophthalmology
- Vol. 61 (3) , 192-201
- https://doi.org/10.1136/bjo.61.3.192
Abstract
Two physicians and two lay readers were trained according to a detailed protocol in the grading of 17 lesions found in diabetic retinopathy by evaluation of stereo fundus photographs according to a modified Airlie House classification. Intraobserver and interobserver variability of these readers was assessed by two methods: weighted kappa, and frequency of agreement within one grade. In general, physician readers were found to be less variable on replicate readings than were lay leaders, and had slightly better agreement with each other than with the lay readers. The physiological significance of the direction and magnitude of the difference between physician and lay reader variability for individual lesions was often uncertain. Assessment of contribution to disagreement by individual readers was possible and permits future training directed at reducing disagreement to acceptable values.This publication has 12 references indexed in Scilit:
- A review of statistical methods in the analysis of data arising from observer reliability studies (Part II)*Statistica Neerlandica, 1975
- The Reliability of Clinical Methods, Data and JudgmentsNew England Journal of Medicine, 1975
- The Reliability of Clinical Methods, Data and JudgmentsNew England Journal of Medicine, 1975
- Standardizing Diagnostic ProceduresAmerican Journal of Ophthalmology, 1975
- An extraordinary opportunity.1973
- An Extraordinary OpportunityAmerican Journal of Ophthalmology, 1973
- Benign Nevi and Malignant Melanomas of the ChoroidAmerican Journal of Ophthalmology, 1973
- Large sample standard errors of kappa and weighted kappa.Psychological Bulletin, 1969
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A proposed index for measuring agreement in test-retest studiesJournal of Chronic Diseases, 1966