A Computer Program to Calculate Adjusted and Unadjusted Interrater Reliabilities for Sets and Subsets of Judges
- 1 October 1975
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 35 (3) , 689-691
- https://doi.org/10.1177/001316447503500321
Abstract
A computer program to be used to assess interrater reliabilities has been written. Given judges' ratings on a set of variables pertaining to subjects or events, the program will produce for each variable, a printed analysis of variance summary table for between subjects/ events, within subjects/events, and between judges sources of variability, a reliability coefficient, an adjusted reliability coefficient and means and standard deviations for each rater. Further, analysis of variance and reliability output for subsets of judges is generated.Keywords
This publication has 2 references indexed in Scilit:
- Statistical principles in experimental design.Published by American Psychological Association (APA) ,1962
- Estimation of the Reliability of RatingsPsychometrika, 1951