A note on interrater agreement
- 1 July 1990
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 9 (7) , 835-839
- https://doi.org/10.1002/sim.4780090713
Abstract
We investigate the properties of a measure of interrater agreement originally proposed by Rogot and Goldberg.1 Unlike commonly used measures, this measure not only adjusts for chance agreement, but it also standardizes for both perfect agreement as well as for perfect disagreement. Further, one can also use this measure to assess category specific conditional agreement, and thus apply it to situations with missing main diagonal data. We provide an asymptotic method for inference with this measure.This publication has 11 references indexed in Scilit:
- Simultaneous lupus anticoagulant and anticardiolipin assays and clinical detection of antiphospholipidsAmerican Journal of Hematology, 1989
- Another look at interrater agreement.Psychological Bulletin, 1988
- 334. Note: Measures for Clinicians' Disagreements over SignsPublished by JSTOR ,1972
- Measures of response agreement for qualitative data: Some generalizations and alternatives.Psychological Bulletin, 1971
- DERIVING COEFFICIENTS OF RELIABILITY AND AGREEMENT FOR RATINGSBritish Journal of Mathematical and Statistical Psychology, 1968
- Quantification of Agreement in Psychiatric DiagnosisArchives of General Psychiatry, 1967
- A proposed index for measuring agreement in test-retest studiesJournal of Chronic Diseases, 1966
- The Measurement of Observer Disagreement in the Recording of SignsJournal of the Royal Statistical Society. Series A (General), 1966
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960