Generalizability Analysis for Performance Assessments of Student Achievement or School Effectiveness
- 1 June 1997
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 57 (3) , 373-399
- https://doi.org/10.1177/0013164497057003001
Abstract
Evidence of the uncertainty attached to school and individual scores is required to avoid over interpretation of results. Generalizability analysis provides in the standard error a suitable indicator of uncertainty. Assessments depart from traditional measurements in ways that require extensions and re interpretatons of generalizability analysis. The authors find, for example, that in many analyses the variance component interpreted as Pupil x Task interaction actually arises in part from instability in pupil performance. It is necessary to recognize in the school-level analysis that pupils are nested in classes and schools. Whether to treat the population of a school's pupils as infinite or as limited to the student body assessed also requires careful consideration.Keywords
This publication has 9 references indexed in Scilit:
- Generalizability of New Standards Project 1993 Pilot Study Tasks in MathematicsApplied Measurement in Education, 1996
- Estimating the Consistency and Accuracy of Classifications Based on Test ScoresJournal of Educational Measurement, 1995
- Evidence and Inference in Educational AssessmentPsychometrika, 1994
- Generalizability of Large-Scale Performance Assessments in Science: Promises and ProblemsApplied Measurement in Education, 1994
- Composite Versus Component Scores: Consistency of School Effectiveness ClassificationApplied Measurement in Education, 1994
- The Vemont Portfolio Assessment Program: Findings and ImplicationsEducational Measurement: Issues and Practice, 1994
- Generalizability TheoryEducational Measurement: Issues and Practice, 1992
- Conditional Standard Errors of Measurement for Scale ScoresJournal of Educational Measurement, 1992
- Variance ComponentsPublished by Wiley ,1992