The Measurement of Writing Ability With a Many-Faceted Rasch Model
- 1 July 1992
- journal article
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 5 (3) , 171-191
- https://doi.org/10.1207/s15324818ame0503_1
Abstract
The purpose of this study is to describe a Many-Faceted Rasch (FACETS) model for the measurement of writing ability. The FACETS model is a multivariate extension of Rasch measurement models that can be used to provide a framework for calibrating both raters and writing tasks within the context of writing assessment. The use of the FACETS model for solving measurement problems encountered in the large-scale assessment of writing ability is presented here. A random sample of 1,000 students from a statewide assessment of writing ability is used to illustrate the FACETS model. The data suggest that there are significant differences in rater severity, even after extensive training. Small, but statistically significant, differences in writing- task difficulty were also found. The FACETS model offers a promising approach for addressing measurement problems encountered in the large- scale assessment of writing ability through written compositions.Keywords
This publication has 12 references indexed in Scilit:
- Editor's NoteApplied Measurement in Education, 1990
- Use of Generalizability Theory for Estimating the Dependability of a Scoring System for Sample EssaysApplied Measurement in Education, 1989
- Applying Partial Credit Analysis to the Construction of Narrative Writing TestsApplied Measurement in Education, 1988
- A Comparison of the Information Provided by Essay, Multiple-Choice, and Free-Response Writing TestsApplied Psychological Measurement, 1988
- Understanding Scoring Reliability: Experiments in Calibrating Essay ReadersJournal of Educational Statistics, 1988
- Calibrating graded assessments: Rasch partial credit analysis of performance in writingLanguage Testing, 1987
- ESTIMATING THE RELIABILITY, VALIDITY, AND INVALIDITY OF ESSAY RATINGSJournal of Educational Measurement, 1985
- Two Simple Models for Rater EffectsApplied Psychological Measurement, 1984
- A Rasch Model for Partial Credit ScoringPsychometrika, 1982
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960