An Ordinal Coefficient of Relational Agreement for Multiple Judges
- 1 June 1994
- journal article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 59 (2) , 241-251
- https://doi.org/10.1007/bf02295186
Abstract
In a recent article, Fagot proposed a generalized family of coefficients of relational agreement for multiple judges, focusing on the concept of empirically meaningful relationships. In this paper an ordinal coefficient of relational agreement, based on ranking data, is presented as a special case of the generalized family. It is shown that the proposed ordinal coefficient encompasses other ordinal coefficients, such as the Kendall coefficient of concordance, the average Spearman rank-order coefficient, and intraclass correlation based on ranks. It is also shown that the Kendall coefficient of concordance, corrected for chance agreement, is equivalent to the ordinal coefficient proposed in this paper.Keywords
This publication has 10 references indexed in Scilit:
- A Generalized Family of Coefficients of Relational Agreement for Numerical ScalesPsychometrika, 1993
- Interobserver relational agreement.Psychological Bulletin, 1989
- A Family of Chance-Corrected Association Coefficients for Metric ScalesPsychometrika, 1986
- A Family of Association Coefficients for Metric ScalesPsychometrika, 1985
- Modeling ordinal scale disagreement.Psychological Bulletin, 1985
- Intraclass correlations: Uses in assessing rater reliability.Psychological Bulletin, 1979
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960
- A method of scalogram analysis using summary statisticsPsychometrika, 1956
- ON SAMPLING FROM A POPULATION OF RANKERSBiometrika, 1952
- III. The influence of rainfall on the yield of wheat at RothamstedPhilosophical Transactions of the Royal Society of London. Series B, Containing Papers of a Biological Character, 1925