The Equivalence of Multiple Rater Kappa Statistics and Intraclass Correlation Coefficients
- 1 April 1988
- journal article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 48 (2) , 367-374
- https://doi.org/10.1177/0013164488482009
Abstract
Using the Gini-Light-Margolin concept of partioning variance for qualitative data, correspondences are established between various kappa statistics and intraclass correlation coefficients under general conditions (multiple raters and polychotomous category systems). A measure of marginal symmetry for multiple ratings is also developed and is shown to have a proportion-of-variance explanation.Keywords
This publication has 10 references indexed in Scilit:
- Kappa, Measures of Marginal Symmetry and Intraclass CorrelationsEducational and Psychological Measurement, 1985
- On Measuring Agreement among Several Judges on the Presence or Absence of a TraitEducational and Psychological Measurement, 1984
- Integration and generalization of kappas for multiple raters.Psychological Bulletin, 1980
- The Reliability of Dichotomous Judgments: Unequal Numbers of Judges per SubjectApplied Psychological Measurement, 1979
- Intraclass correlations: Uses in assessing rater reliability.Psychological Bulletin, 1979
- The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of ReliabilityEducational and Psychological Measurement, 1973
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971
- An Analysis of Variance for Categorical DataJournal of the American Statistical Association, 1971
- Bivariate Agreement Coefficients for Reliability of DataSociological Methodology, 1970
- Estimating the Accuracy of Dichotomous JudgmentsPsychometrika, 1965