A procedure for evaluating the reliability of a gingivitis index
- 1 May 1986
- journal article
- clinical trial
- Published by Wiley in Journal of Clinical Periodontology
- Vol. 13 (5) , 385-391
- https://doi.org/10.1111/j.1600-051x.1986.tb01479.x
Abstract
A methodology is presented for assessing the reliability of an ordinarily-scaled index and is illustrated by using data from a clinical trial in which gingival inflammation was assessed with the PMGI index, independently, by 5 examiners. One of the examiners was an experienced examiner, the others newly trained. All subjects were evaluated by each examiner initially and at the end of the study period. The reliability of the average score per subject, maximum score per subject, and the % of affected sites per person are estimated by the intraclass correlation coefficient. Procedures are presented that utilize various forms of the weighted kappa statistic for dissecting patterns in examiner agreement for specific sites, types of site, all sites, and for the individual components and categories of the index. It is shown how these procedures can be useful for training and calibrating multiple examiners, who will be using such an index in a clinical study, so that adequate reliability levels can be realized.Keywords
This publication has 13 references indexed in Scilit:
- Current status of indices of gingivitisJournal of Clinical Periodontology, 1986
- Current status of indices of plaqueJournal of Clinical Periodontology, 1986
- Measuring Agreement for Multinomial DataPublished by JSTOR ,1982
- Inter-examiner Reliability in Caries TrialsJournal of Dental Research, 1979
- Comparison of the Null Distributions of Weighted Kappa and the C Ordinal StatisticApplied Psychological Measurement, 1977
- Assessing Inter-Rater Reliability for Rating Scales: Resolving some Basic IssuesThe British Journal of Psychiatry, 1976
- Clinical Reduction of Gingivitis through the Use of a Mouthwash Containing Two Quaternary Ammonium CompoundsThe Journal of Periodontology, 1976
- The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of ReliabilityEducational and Psychological Measurement, 1973
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960