A PROBABILITY‐BASED FORMULA FOR CALCULATING INTEROBSERVER AGREEMENT
- 28 February 1977
- journal article
- research article
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 10 (1) , 127-131
- https://doi.org/10.1901/jaba.1977.10-127
Abstract
Estimates of observer agreement are necessary to assess the acceptability of interval data. A common method for assessing observer agreement, per cent agreement, includes several major weaknesses and varies as a function of the frequency of behavior recorded and the inclusion or exclusion of agreements on nonoccurrences. Also, agreements that might be expected to occur by chance are not taken into account. An alternative method for assessing observer agreement that determines the exact probability that the obtained number of agreements or better would have occurred by chance is presented and explained. Agreements on both occurrences and nonoccurrences of behavior are considered in the calculation of this probability.Keywords
This publication has 3 references indexed in Scilit:
- Methodology for Experimental Studies of Young Children in Natural SettingsThe Psychological Record, 1969
- Observing the Classroom Behavior of Elementary School ChildrenExceptional Children, 1969
- The use of the clinical method in experimental studies of behavior.The Journal of Abnormal and Social Psychology, 1936