Customized Tests and Customized Norms
- 1 July 1991
- journal article
- Published by Taylor & Francis in Applied Measurement in Education
- Vol. 4 (3) , 185-207
- https://doi.org/10.1207/s15324818ame0403_1
Abstract
With increasing interest in educational accountability, test results are now expected to meet a diverse set of informational needs. But a norm-referenced test (NRT) cannot be expected to meet the simultaneous demands for both norm-referenced and curriculum-specific information. One possible solution, which is the focus of this article, is to customize the NRT. Customized tests may appear in any form. They may (a) add a few curriculum-specific items to the end of the NRT, (b) substitute locally constructed items for a few NRT items, (c) substitute a curriculum-specific test (CST) for the NRT, or (d) use equating methods to obtain predicted NRT scores from the CST scores. In this article, we describe the four main approaches to customized testing, address the validity of the uses and interpretations of customized test scores obtained from the four main approaches, and offer recommendations regarding the use of customized tests and the need for further research. Results indicate that customized testing can yield both valid normative and curriculum- specific information, when special conditions exist. But, there are also many threats to the validity of normative interpretations. Cautious application of customized testing is needed in order to avoid misleading inferences about student achievement.Keywords
This publication has 15 references indexed in Scilit:
- Inflated Test Score Gains: Is the Problem Old Norms or Teaching the Test?Educational Measurement: Issues and Practice, 1990
- IRT Ability Estimates from Customized Achievement Tests Without Representative Content SamplingApplied Measurement in Education, 1989
- The Effect of Deleting Content-Related Items on IRT Ability EstimatesEducational and Psychological Measurement, 1987
- Accountability: The Comparison of Educational Systems and the Quality of Test ResultsEducational Policy, 1987
- Valid Normative Information From Customized Achievement TestsEducational Measurement: Issues and Practice, 1987
- Public Policy and the Testing Profession—You've Never Had it so Good?Educational Measurement: Issues and Practice, 1985
- Implications for Altering the Context in Which Test Items Appear: A Historical Perspective on an Immediate ConcernReview of Educational Research, 1985
- Using Standardized Tests for Assessing Local Learning ObjectivesEducational Measurement: Issues and Practice, 1984
- Customizing a Norm-Referenced Achievement Test to Achieve Curricular Validity: A Case StudyEducational Measurement: Issues and Practice, 1984
- THE EXTENT, CAUSES AND IMPORTANCE OF CONTEXT EFFECTS ON ITEM PARAMETERS FOR TWO LATENT TRAIT MODELSJournal of Educational Measurement, 1980