Identification of Nonuniform Differential Item Functioning Using a Variation of the Mantel-Haenszel Procedure
- 1 June 1994
- journal article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 54 (2) , 284-291
- https://doi.org/10.1177/0013164494054002003
Abstract
The Mantel-Haenszel (MH) procedure has become one of the most popular procedures for detecting differential item functioning (DIF). One of the most troublesome criticisms of this procedure is that whereas detection rates for uniform DIF are very good, the procedure is not sensitive to nonuniform DIF. In this study, examinee responses were generated to simulate both uniform and nonuniform DIF. A standard MH procedure was used first. Then, examinees were split into two samples by breaking the full sample at approximately the middle of the test score distribution. The tests were then reanalyzed, first with the low-performing sample and then with the high-performing sample. This variation improved detection rates of nonuniform DIF considerably over the total sample procedure without increasing the Type I error rate. Items with the largest differences in discrimination and difficulty parameters were most likely to be identified.Keywords
This publication has 8 references indexed in Scilit:
- The Effect of Sample Size on the Functioning of the Mantel-Haenszel StatisticEducational and Psychological Measurement, 1992
- Detecting Differential Item Functioning Using Logistic Regression ProceduresJournal of Educational Measurement, 1990
- Differential item functioning: Implications for test translations.Journal of Applied Psychology, 1989
- Detecting Potentially Biased Test Items: Comparison of IRT Area and Mantel-Haenszel MethodsApplied Measurement in Education, 1989
- A Consumer's Guide to Statistics for Identifying Differential Item FunctioningApplied Measurement in Education, 1989
- SAT Differential Item Performance for Nine Handicapped GroupsJournal of Educational Measurement, 1987
- Contingency Table Models for Assessing Item BiasJournal of Educational Statistics, 1982
- Item Bias in a Test of Reading ComprehensionApplied Psychological Measurement, 1981