Item Profile Analysis for Tests Developed According to a Table of Specifications

Abstract
An approach to analyzing items is described that emphasizes the heterogeneous nature of many achieve ment and professional certification tests. The approach focuses on the categories of a table of specifications, which often serves as a blueprint for constructing such tests. The approach is characterized by profile compar isons of observed and expected correlations of item scores with category scores. A multivariate generaliza bility theory model provides the foundation for the ap proach, and the concept of a profile of expected corre lations is derived from the model. Data from a professional certification testing program are used for illustration and an attempt is made to provide links with test development issues and generalizability the ory.

This publication has 2 references indexed in Scilit: