Expert-System Scores for Complex Constructed-Response Quantitative Items: A Study of Convergent Validity
- 1 September 1991
- journal article
- research article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 15 (3) , 227-239
- https://doi.org/10.1177/014662169101500302
Abstract
This study investigated the convergent validity of expert-system scores for four mathematical constructed-response item formats. A five-factor model comprised of four constructed-response for mat factors and a Graduate Record Examination (GRE) General Test quantitative factor was posed. Confirmatory factor analysis was used to test the fit of this model and to compare it with several alter natives. The five-factor model fit well, although a solution comprised of two highly correlated dimensions_GRE-quantitative and constructed- response—represented the data almost as well. These results extend the meaning of the expert system's constructed-response scores by relating them to a well-established quantitative measure and by indicating that they signify the same underlying proficiency across item formats.Keywords
This publication has 16 references indexed in Scilit:
- A COMPARISON OF OPEN-ENDED AND MULTIPLE-CHOICE QUESTION FORMATS FOR THE QUANTITATIVE SECTION OF THE GRADUATE RECORD EXAMINATIONS GENERAL TESTETS Research Report Series, 1991
- Equivalence of Free‐Response and Multiple‐Choice ItemsJournal of Educational Measurement, 1991
- The Relationship of Expert-System Scored Constrained Free-Response Items to Multiple-Choice and Open-Ended ItemsApplied Psychological Measurement, 1990
- Scoring Constructed Responses Using Expert SystemsJournal of Educational Measurement, 1990
- A Systems Approach to Educational TestingEducational Researcher, 1989
- New Directions in Educational AssessmentEducational Researcher, 1989
- Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.Psychological Bulletin, 1988
- Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups.Psychological Bulletin, 1985
- Cross-Validation Of Covariance StructuresMultivariate Behavioral Research, 1983
- Frequency norms and structural analysis of algebra story problems into families, categories, and templatesInstructional Science, 1981