GENERALIZABILITY OF BEHAVIORAL OBSERVATIONS - CLARIFICATION OF INTEROBSERVER AGREEMENT AND INTEROBSERVER RELIABILITY
- 1 January 1979
- journal article
- review article
- Vol. 83 (5) , 460-472
Abstract
Indices [16] of interobserver [human] agreement and methods [6] for estimating coefficients of interobserver reliability were critiqued. The agreement statistics were imprecise, limited psychometrically and relatively inflexible in terms of the diverse categorical and quantitative data sets typically encountered in mental retardation research. Of the reliability statistics 5 produced precise estimates of agreement, yet possessed similar limitations. Only the intraclass correlation-generalizability theory approach seemed to offer the precision, comprehensiveness and flexibility required to deal with the complexity of reliability assessment. A basic generalizability model was described and illustrated with group and single-subject research data.This publication has 14 references indexed in Scilit:
- Inference About Weighted Kappa in the Non-Null CaseApplied Psychological Measurement, 1978
- ARTIFACT, BIAS, AND COMPLEXITY OF ASSESSMENT: THE ABCs OF RELIABILITYJournal of Applied Behavior Analysis, 1977
- OBSERVER AGREEMENT, CREDIBILITY, AND JUDGMENT: SOME CONSIDERATIONS IN PRESENTING OBSERVER AGREEMENT DATAJournal of Applied Behavior Analysis, 1977
- EVALUATING INTEROBSERVER RELIABILITY OF INTERVAL DATA1Journal of Applied Behavior Analysis, 1977
- CONSIDERATIONS IN THE CHOICE OF INTEROBSERVER RELIABILITY ESTIMATESJournal of Applied Behavior Analysis, 1977
- A PROBABILITY‐BASED FORMULA FOR CALCULATING INTEROBSERVER AGREEMENTJournal of Applied Behavior Analysis, 1977
- ON THE METHODS AND THEORY OF RELIABILITYJournal of Nervous & Mental Disease, 1976
- DIMENSIONS OF ADAPTIVE-BEHAVIOR IN INSTITUTIONALIZED MENTALLY-RETARDED CHILDREN AND ADULTS - DEVELOPMENTAL PERSPECTIVE1976
- Quantification of Agreement in Psychiatric DiagnosisArchives of General Psychiatry, 1967
- Measures of Association for Cross ClassificationsJournal of the American Statistical Association, 1954