Imprecise terms in UK medical multiple‐choice questions: what examiners think they mean
- 1 July 1998
- journal article
- research article
- Published by Wiley in Medical Education
- Vol. 32 (4) , 343-350
- https://doi.org/10.1046/j.1365-2923.1998.00203.x
Abstract
Many multiple‐choice questions (MCQs) used in medical education in the UK contain undefined, imprecise terms. They are particularly common in true/false items and can be found in classroom tests, published examples of MCQs and, more importantly, in high‐stakes examinations which determine a candidate's graduation or membership of a professional body. This study investigated imprecise terms used in some MB BS finals examinations and the Part 1 Membership Examination of the Royal College of Physicians. It revealed that imprecise terms occur commonly, yet there is a wide range of opinion among the examiners themselves about their meanings. The numbers and variety of imprecise terms which were found in high‐stakes MCQ examinations are described in this paper and details are given concerning the lack of consensus about their meanings as reported by the responsible examiners. A second type of construction error – disproportionately large numbers of `true' branches – was also recorded. Exemplary practices do exist in MCQ quality assurance, but in the UK they are very much the exception rather than the rule. The findings of this investigation strongly indicate a need for change.Keywords
This publication has 6 references indexed in Scilit:
- The use of imprecise terms in examination questionsAcademic Medicine, 1994
- The multiple choice true/false question: what does it measure and what could it measure?Medical Teacher, 1992
- Validity and Reliability of True-False TestsEducational and Psychological Measurement, 1985
- Between Never and AlwaysNew England Journal of Medicine, 1981
- WHAT DO WE MEAN BY "USUALLY"?The Lancet, 1980
- Constructing multiple choice questions of the multiple true/false typeMedical Education, 1979