Sensitivity and Specificity of Outcome Measures in Patients with Neck Pain: Detecting Clinically Significant Improvement
- 1 November 2004
- journal article
- research article
- Published by Wolters Kluwer Health in Spine
- Vol. 29 (21) , 2410-2417
- https://doi.org/10.1097/01.brs.0000143080.74061.25
Abstract
Prospective, single-cohort study. To determine the relative sensitivity of a range of outcome measures used in evaluating treatment interventions in patients with neck pain and the magnitude of change scores on the neck Bournemouth Questionnaire and the cutoff score on the Patients’ Global Impression of Change scale associated with clinically significant improvement. Traditionally, evaluation of treatment interventions using subjective outcome measures has been based on the statistical significance of the difference between group mean values. To be clinically meaningful, however, information is required from sensitive outcome measures on the proportion of patients undergoing a clinically important improvement and from this, the number needed to treat for a single patient to benefit. Patients with nonspecific neck pain from a number of treatment centers completed a battery of self-report questionnaires, including the Bournemouth Questionnaire, before and after chiropractic treatment. After treatment, patients also completed a retrospective analysis of their overall improvement since the start of treatment (Patients’ Global Impression of Change). The a priori definition of clinically significant improvement was defined as a Reliable Change Index on the Bournemouth Questionnaire of >1.96. The best cutoffs with a balance between the highest sensitivity and highest specificity in detecting clinical improvement were a score of 2 or less on the Patients’ Global Impression of Change (11-point Numerical Rating Scale: 0 = much better, 5 = no change, and 10 = much worse) and a raw change score of three or more points on each of the seven 11-point Numerical Rating Scale subscales of the Bournemouth Questionnaire. For the total score of the Bournemouth Questionnaire, raw change scores of 13 or more points, percentage change scores of 36% or more, and individual effect sizes of 1.0 or more were all associated with clinically significant improvement. The sensitivity of the Bournemouth Questionnaire in terms of its effect size was comparable with that of pain intensity scales and the Neck Disability Index. The present findings will assist in the choice of outcome measures in trials on neck pain. The study also illustrates a methodologic framework for interpreting change scores in terms of clinical improvement, facilitating the process of making sense of research data in the clinical setting.Keywords
This publication has 27 references indexed in Scilit:
- Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scalePAIN®, 2001
- Defining the clinically important difference in pain outcome measuresPAIN®, 2000
- "Statistical Significance and Clinical Significance Are Not Synonyms!"The Clinical Journal of Pain, 2000
- New perspectives in the evidence‐based healthcare debateJournal of Evaluation in Clinical Practice, 2000
- Determining Clinically Important Differences in Health Status MeasuresPharmacoEconomics, 1999
- Interdisciplinary treatment for fibromyalgia syndrome: Clinical and statistical significanceArthritis & Rheumatism, 1998
- Interpreting treatment effects in randomised trialsBMJ, 1998
- Determining a minimal important change in a disease-specific quality of life questionnaireJournal of Clinical Epidemiology, 1994
- Measurement of health statusControlled Clinical Trials, 1989
- Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significanceBehavior Therapy, 1984