A CAUTIONARY NOTE ON THE USE OF PROBABILITY VALUES TO EVALUATE INTEROBSERVER AGREEMENT
- 1 March 1982
- journal article
- research article
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 15 (1) , 189-190
- https://doi.org/10.1901/jaba.1982.15-189
Abstract
Proposed methods of assessing the statistical significance of interobserver agreements provide erroneous probability values when conducted on serially correlated data. Investigators who wish to evaluate interobserver agreements by means of statistical significance can do so by limiting the analysis to every kth interval of data, or by using Markovian techniques which accommodate serial correlations.Keywords
This publication has 9 references indexed in Scilit:
- Studies on the development of extra-endothelial and intra-endothelial pigment deposits by means of direct and indirect contact specular microscopy of the corneaAlbrecht von Graefes Archiv für Ophthalmologie, 1982
- INTERRUPTED TIME‐SERIES ANALYSIS AND ITS APPLICATION TO BEHAVIORAL DATAJournal of Applied Behavior Analysis, 1980
- RELIABILITY IN THE CONTEXT OF THE EXPERIMENT: A Commentary on Two Articles by Birkimer and BrownJournal of Applied Behavior Analysis, 1979
- PROPOSED CONVENTIONS FOR EVALUATING OBSERVER RELIABILITY: A Commentary on Two Articles by Birkimer and BrownJournal of Applied Behavior Analysis, 1979
- APPLIED BEHAVIOR ANALYSIS AND INTEROBSERVER RELIABILITY: A Commentary on Two Articles by Birkimer and BrownJournal of Applied Behavior Analysis, 1979
- BACK TO BASICS: PERCENTAGE AGREEMENT MEASURES ARE ADEQUATE, BUT THERE ARE EASIER WAYSJournal of Applied Behavior Analysis, 1979
- CONSIDERATIONS IN THE CHOICE OF INTEROBSERVER RELIABILITY ESTIMATESJournal of Applied Behavior Analysis, 1977
- A PROBABILITY‐BASED FORMULA FOR CALCULATING INTEROBSERVER AGREEMENTJournal of Applied Behavior Analysis, 1977
- Statistical Inference about Markov ChainsThe Annals of Mathematical Statistics, 1957