Optimizing Balanced Incomplete Block Designs for Educational Assessments
- 1 September 2004
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 28 (5) , 317-331
- https://doi.org/10.1177/0146621604264870
Abstract
A popular design in large-scale educational assessments as well as any other type of survey is the balanced incomplete block design. The design is based on an item pool split into a set of blocks of items that are assigned to sets of “assessment booklets.” This article shows how the problem of calculating an optimal balanced incomplete block design can be formulated as a problem in combinatorial optimization. Several examples of structural and practical requirements for balanced incomplete block designs are shown to be linear constraints on the optimization problem. In addition, a variety of possible objective functions to optimize the design is discussed. The technique is demonstrated using the 1996 Grade 8 Mathematics National Assessment of Educational Progress (NAEP) as a case study.Keywords
This publication has 11 references indexed in Scilit:
- Multidimensional Constrained Test AssemblyApplied Psychological Measurement, 2002
- Using Response-Time Constraints to Control for Differential Speededness in Computerized Adaptive TestingApplied Psychological Measurement, 1999
- Simultaneous Assembly of Multiple Test FormsJournal of Educational Measurement, 1998
- Optimal Assembly of Psychological and Educational TestsApplied Psychological Measurement, 1998
- A Generalized Partial Credit ModelPublished by Springer Nature ,1997
- Assembling Tests for the Measurement of Multiple TraitsApplied Psychological Measurement, 1996
- Estimating Population Characteristics From Sparse Matrix Samples of Item ResponsesJournal of Educational Measurement, 1992
- A Generalized Partial Credit Model: Application of an EM AlgorithmApplied Psychological Measurement, 1992
- The Design of the National Assessment of Educational ProgressJournal of Educational Measurement, 1992
- Estimating Norms by Item-SamplingEducational and Psychological Measurement, 1962