Empirical Validation of Criterion-Referenced Tests

Abstract
This study examined the test-retest reliability and criterion validity of basal mastery tests of three widely used commercial reading series. Traditional correlational analyses as well as statistical procedures developed specifically for criterion-referenced tests were employed. Results indicated that the reliability and validity of the basal mastery tests varied among and within instruments. Additional analyses revealed a strong relation between traditional and criterion-referenced strategies for describing test-retest reliability, but a more modest relation between traditional and alternative analyses of criterion validity. Implications for developing and using basal mastery tests and describing their adequacy are discussed.