Multivariate Generalizability Theory in Educational Measurement: An Empirical Study

Publisher Website
Google Scholar
Abstract
Multivariate generalizability theory was applied to the assessment of student achievement in art educa tion. Twenty-five art students rated the paintings of 60 fourth-grade students with regard to three criteria. Paintings were made on four different topics. The re sults indicate that generalizability is low with respect to different raters and moderate with respect to differ ent topics. The three ratings a rater gave on a single painting were moderately correlated. As indicated by the results for the covariance components, nearly half of the covariance between the three criteria was be cause the three ratings were from the same rater. Ex pected values for σ2(Δ) are reported for different D study designs.