Investigating the Use of Negatively Phrased Survey Items in Medical Education Settings: Common Wisdom or Common Mistake?
- 1 October 2004
- journal article
- Published by Wolters Kluwer Health in Academic Medicine
- Vol. 79 (Supplement) , S18-S20
- https://doi.org/10.1097/00001888-200410001-00006
Abstract
Attitude surveys in medical education often combine negative items with positive items, a "common wisdom" strategy to counteract response sets. A body of research in other fields has demonstrated that negatively phrased items affect reliability and validity by introducing measurement artifact into scores. The authors investigated the effect of negatively phrased items in the Medical School Learning Environment Survey (MSLES) with data from six medical student cohorts at the University of Texas Medical Branch, Galveston, Texas. This study describes the impact of negatively phrased items in the MSLES through analysis of item and scale means and comparisons of coefficient alpha values. Findings indicate that negatively phrased items performed differently than the positively phrased items. Negatively phrased items were associated with lower scale reliability. The authors conclude, as did earlier studies, that negatively phrased items introduce an artifact into attitude measurement. The "common wisdom" practice of routinely including negative items should be employed with care.Keywords
This publication has 8 references indexed in Scilit:
- The Jefferson Scale of Physician EmpathyAcademic Medicine, 2002
- Effects of Stem and Likert Response Option Reversals on Survey Internal Consistency: If You Feel the Need, There is a Better Alternative to Using those Negatively Worded StemsEducational and Psychological Measurement, 2000
- Medical student perception of the academic environmentAcademic Medicine, 1997
- Positive and negative global self-esteem: A substantively meaningful distinction or artifactors?Journal of Personality and Social Psychology, 1996
- The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental InvestigationEducational and Psychological Measurement, 1991
- The Impact of Positive and Negative Item Stems on the Validity of a Computer Anxiety ScaleEducational and Psychological Measurement, 1990
- Factors Defined by Negatively Keyed Items: The Result of Careless Respondents?Applied Psychological Measurement, 1985
- The Effect of Grouping or Randomizing Items on Leniency Response BiasEducational and Psychological Measurement, 1981