A rapid non-parametric estimate of multi-judge reliability
- 1 March 1956
- journal article
- research article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 21 (1) , 17-29
- https://doi.org/10.1007/bf02289084
Abstract
A technique is presented for obtaining a rapid estimate of reliability between judges, with special reference to qualitative judgments. It is shown that reliability and discrimination are independent and that estimates of both are needed. A method of obtaining an independent estimate of multi-judge discrimination is developed. It is shown that the size of item-samples is specified by the latter method. Tests of significance for both reliability and discrimination are described.Keywords
This publication has 6 references indexed in Scilit:
- The amount of information in absolute judgments.Psychological Review, 1951
- Unitizing and categorizing problems in coding qualitative dataJournal of Clinical Psychology, 1950
- DiscussionJournal of Clinical Psychology, 1950
- Problems of multi-judge reliabilityJournal of Clinical Psychology, 1950
- A Chart of the Chi-Square DistributionJournal of the American Statistical Association, 1944
- The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of VarianceJournal of the American Statistical Association, 1937