The Use of Questionnaires in Child Psychiatry Research: Measuring their Performance and Choosing an Optimal Cut‐Off
- 1 May 1991
- journal article
- Published by Wiley in Journal of Child Psychology and Psychiatry
- Vol. 32 (4) , 677-693
- https://doi.org/10.1111/j.1469-7610.1991.tb00343.x
Abstract
This paper introduces the basic principles of Receiver Operating Characteristics (ROC) analysis, a technique to evaluate and compare the discriminant power of questionnaires employed in psychiatric research. ROC curves may assist in the selection of an optimal cut-off point, which has been shown to depend upon the prevalence rate, the consequences of correct and incorrect classifications, and the distributions of scale scores among normal individuals and cases. Then, ROC analysis is applied to the Child Behavior Checklist on a sample of 564 6–11-year old French children. The performances of the social competence scales of this instrument are poorer than those of the behavior problem scales. The findings suggest also that the cut-offs should be varied within this same age group and be higher for screening in community surveys. Further applications of ROC analysis are discussed.Keywords
This publication has 33 references indexed in Scilit:
- The Child Behaviour Checklist and the Rutter Parental Questionnaire: a comparison between two screening instrumentsPsychological Medicine, 1989
- The depression screening instrument (DSI): a device for the detection of depressive disorders in general practiceJournal of Affective Disorders, 1989
- Validation of a computerized assessment (PROQSY) of minor psychological morbidity by Relative Operating Characteristic analysis using a single GP's assessments as criterion measuresPsychological Medicine, 1989
- Evaluating the Use of Mental Health Screening Scales in Primary Care Settings Using Receiver Operating Characteristic CurvesMedical Care, 1987
- Italian version of the organic brain syndrome and the depression scales from the CARE: evaluation of their performance in geriatric institutionsPsychological Medicine, 1987
- Misclassification by psychiatric screening questionnairesJournal of Chronic Diseases, 1986
- Indices of discrimination or diagnostic accuracy: Their ROCs and implied models.Psychological Bulletin, 1986
- A comparison of the validity of two psychiatric screening questionnaires (GHQ-12 and SRQ-20) in Brazil, using Relative Operating Characteristic (ROC) analysisPsychological Medicine, 1985
- SELECTING MEASURES OF EMOTIONAL AND BEHAVIORAL DISORDERS OF CHILDHOOD FOR USE IN GENERAL POPULATIONSJournal of Child Psychology and Psychiatry, 1985
- A CHILDREN'S BEHAVIOUR QUESTIONNAIRE FOR COMPLETION BY TEACHERS: PRELIMINARY FINDINGSJournal of Child Psychology and Psychiatry, 1967