Measuring Nominal Scale Agreement Between a Judge and a Known Standard
- 1 June 1978
- journal article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 43 (2) , 213-223
- https://doi.org/10.1007/bf02293864
Abstract
Two designs for comparing a judge's ratings with a known standard are presented and compared. Design A pertains to the situation where the judge is asked to categorize each of N subjects into one of r (known) classes with no knowledge of the actual number in each class. Design B is employed when the judge is given the actual number in each class and is asked to categorize the individuals subject to these constraints. The probability distribution of the total number of correct choices is developed in each case. A power comparison of the two procedures is undertaken.Keywords
This publication has 6 references indexed in Scilit:
- Some Exact Conditional Tests of Independence for R × C Cross-Classification TablesPsychometrika, 1977
- On the Efficiency of Fisher's Tea-Tasting DesignsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1975
- Remark on algorithm 434: exact probabilities for R×C contingency tablesCommunications of the ACM, 1974
- The Lady Tasting Tea, and Allied TopicsJournal of the American Statistical Association, 1959
- NOTE ON AN EXACT TREATMENT OF CONTINGENCY, GOODNESS OF FIT AND OTHER PROBLEMS OF SIGNIFICANCEBiometrika, 1951
- EXTENSION OF THE NEYMAN-PEARSON THEORY OF TESTS TO DISCONTINUOUS VARIATESBiometrika, 1950