The Validity of Two Item-Writing Rules

Abstract
A recent review of research revealed that much of the advice given for writing multiple-choice test items is based on experience and wisdom rather than empirical research. The present study involved the testing of two common item-writing rules: (1) the phrasing of the stem in the form of a question versus a partial sentence and (2) the use of the inclusive “none of the above” option instead of a specific content option. Limited empirical research suggests that using the partial sentence format and the inclusive “none of these” option may lead to undesirable item and test characteristics, whereas textbook authors essentially are divided on the opinions about the validity of each rule. Results of this experimental study offer no evidence to support the use of either type of stem and limited evidence to caution against the option “none of the above.”