Differential Item Functioning Analysis With Ordinal Logistic Regression Techniques
- 1 November 2006
- journal article
- Published by Wolters Kluwer Health in Medical Care
- Vol. 44 (Suppl 3) , S115-S123
- https://doi.org/10.1097/01.mlr.0000245183.28384.ed
Abstract
We present an ordinal logistic regression model for identification of items with differential item functioning (DIF) and apply this model to a Mini-Mental State Examination (MMSE) dataset. We employ item response theory ability estimation in our models. Three nested ordinal logistic regression models are applied to each item. Model testing begins with examination of the statistical significance of the interaction term between ability and the group indicator, consistent with nonuniform DIF. Then we turn our attention to the coefficient of the ability term in models with and without the group term. If including the group term has a marked effect on that coefficient, we declare that it has uniform DIF. We examined DIF related to language of test administration in addition to self-reported race, Hispanic ethnicity, age, years of education, and sex. We used PARSCALE for IRT analyses and STATA for ordinal logistic regression approaches. We used an iterative technique for adjusting IRT ability estimates on the basis of DIF findings. Five items were found to have DIF related to language. These same items also had DIF related to other covariates. The ordinal logistic regression approach to DIF detection, when combined with IRT ability estimates, provides a reasonable alternative for DIF detection. There appear to be several items with significant DIF related to language of test administration in the MMSE. More attention needs to be paid to the specific criteria used to determine whether an item has DIF, not just the technique used to identify DIF.Keywords
This publication has 20 references indexed in Scilit:
- Test bias in a cognitive test: differential item functioning in the CASIStatistics in Medicine, 2004
- Evaluating Type I Error and Power Rates Using an Effect Size Measure With the Logistic Regression Procedure for DIF DetectionApplied Measurement in Education, 2001
- Combined evidence from multiple outcomes in a clinical trial.Journal of Clinical Epidemiology, 2000
- Logistic Regression and Its Use in Detecting Differential Item Functioning in Polytomous ItemsJournal of Educational Measurement, 1996
- Simulation Study of Confounder-Selection StrategiesAmerican Journal of Epidemiology, 1993
- A Comparison of Logistic Regression and Mantel-Haenszel Procedures for Detecting Differential Item FunctioningApplied Psychological Measurement, 1993
- Logistic Discriminant Function Analysis for DIF Identification of Polytomously Scored ItemsJournal of Educational Measurement, 1993
- Procedures for Extending Item Bias Detection Techniques to Polytomously Scored ItemsApplied Measurement in Education, 1993
- Detecting Differential Item Functioning Using Logistic Regression ProceduresJournal of Educational Measurement, 1990
- Item bias and item response theoryInternational Journal of Educational Research, 1989