The Relationship of Expert-System Scored Constrained Free-Response Items to Multiple-Choice and Open-Ended Items
- 1 June 1990
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 14 (2) , 151-162
- https://doi.org/10.1177/014662169001400204
Abstract
This study examined the relationship of an expert- system scored constrained free-response item (requir ing the student to debug a faulty computer program) to two other item types: (1) multiple-choice and (2) free- response (requiring production of a program). Confir matory factor analysis was used to test the fit of a three-factor model to these data and to compare the fit of the model to three alternatives. These models were fit using two random-half samples, one given a faulty program containing one bug and the other a program with three bugs. A single-factor model best fit the data for the sample taking the one-bug constrained free re sponse and a two-factor model fit the data somewhat better for the second sample. In addition, the factor intercorrelations showed this item type to be highly re lated to both the free-response and multiple-choice measures.Keywords
This publication has 10 references indexed in Scilit:
- A Comparison of the Information Provided by Essay, Multiple-Choice, and Free-Response Writing TestsApplied Psychological Measurement, 1988
- Understanding Scoring Reliability: Experiments in Calibrating Essay ReadersJournal of Educational Statistics, 1988
- Open-Ended Versus Multiple-Choice Response Formats—It Does Make a Difference for Diagnostic PurposesApplied Psychological Measurement, 1987
- Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups.Psychological Bulletin, 1985
- Use of Null Models in Evaluating the Fit of Covariance Structure ModelsSociological Methodology, 1985
- A Comparison of Free-Response and Multiple-Choice Forms of Verbal Aptitude TestsApplied Psychological Measurement, 1982
- Factor Theories of Intelligence are All Right AlmostEducational Researcher, 1980
- CONSTRUCT VALIDITY OF FREE‐RESPONSE AND MACHINE‐SCORABLE FORMS OF A TESTJournal of Educational Measurement, 1980
- On the Equivalence of Constructed- Response and Multiple-Choice TestsApplied Psychological Measurement, 1977
- A reliability coefficient for maximum likelihood factor analysisPsychometrika, 1973