Subjective Judgment of Multiple-Choice Item Characteristics
- 1 June 1983
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 43 (2) , 563-570
- https://doi.org/10.1177/001316448304300227
Abstract
This study was concerned with the reliability and validity of subjective judgments about five characteristics of multiple-choice test items from an introductory astronomy test: (a) item difficulty, (b) language complexity, (c) content importance or relevance, (d) response set convergence, and (e) process complexity. Judgments of item difficulty were the least reliable. Judgments on all characteristics were significantly associated with empirical values of objective item difficulty, which served as the criterion measure. Complexity exhibited the closest relationship with both empirical (objective) and judged (subjective) item difficulty.Keywords
This publication has 9 references indexed in Scilit:
- Reliability and Validity of a Priori Estimates of Item Characteristics for an Examination of Health Science InformationEducational and Psychological Measurement, 1980
- Components of geometric analogy solutionCognitive Psychology, 1980
- Logical Versus Empirical Estimates of Item DifficultyEducational and Psychological Measurement, 1977
- TEACHER JUDGMENTS OF TEST ITEM PROPERTIES1Journal of Educational Measurement, 1968
- Some Determinants of the Difficulty of Non-Verbal Classification ItemsEducational and Psychological Measurement, 1961
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960
- The Improvement of Estimates of Test DifficultyEducational and Psychological Measurement, 1953
- A Suggested Technique for the Improvement of Difficulty Prediction of Test ItemsEducational and Psychological Measurement, 1952
- ON THE METHOD OF PAIRED COMPARISONSBiometrika, 1940