Use of Generalizability Theory for Estimating the Dependability of a Scoring System for Sample Essays
- 1 July 1989
- journal article
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 2 (3) , 195-205
- https://doi.org/10.1207/s15324818ame0203_1
Abstract
This article illustrates the use of generalizability theory for evaluating the dependability of an experimental system for scoring essays. The proposed system was originally planned to be transportable, that is, usable by educators who were trained only by reading and using the materials included in the self-instructional package accompanying the prompt and prescored examples. Because an intended use of the system involved national norms for interpreting performance of students writing essays, both absolute and relative error variances were analyzed.Keywords
This publication has 5 references indexed in Scilit:
- A Domain‐Referenced Approach to Diagnostic Testing Using Generalizability TheoryJournal of Educational Measurement, 1987
- ESTIMATING THE RELIABILITY, VALIDITY, AND INVALIDITY OF ESSAY RATINGSJournal of Educational Measurement, 1985
- Toward Successful Large‐Scale Writing Assessment: Where are we now? Where do we go from here?Educational Measurement: Issues and Practice, 1984
- Issues in Direct Writing Assessment: Problem Identification and ControlEducational Measurement: Issues and Practice, 1984
- Exemplary LEA Practice: Writing Assessment for Program ImprovementEducational Measurement: Issues and Practice, 1984