A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions
Journal Title: International Journal of Assessment Tools in Education - Year 2015, Vol 2, Issue 1
Abstract
This study investigated the effectiveness of logistic regression models to detect uniform and non-uniform DIF in polytomous items across small sample sizes and non-normality of ability distributions. A simulation study was used to compare three logistic regression models, which were the cumulative logits model, the continuation ratio model, and the adjacent categories model. The results revealed that logistic regression was a powerful method to detect DIF in polytomous items, but not useful to distinguish the type of DIF. Continuation ratio model worked best to detect uniform DIF, but the cumulative logits model gave more acceptable type I error results. As sample size increased, type I errors increased at cumulative logits model results. Skewness of ability distributions reduced power of logistic regression to detect non-uniform DIF. Small sample sizes reduced power of logistic regression.
Authors and Affiliations
Yasemin KAYA, Walter L. LEITE, M. David MILLER
Investigating the Impact of Missing Data Handling Methods on the Detection of Differential Item Functioning
In this study, it is aimed to investigate the impact of different missing data handling methods on the detection of Differential Item Functioning methods (Mantel Haenszel and Standardization methods based on Classical Te...
Development of “Willingness to Become School Administrator and Adjustment Scale”
The purpose of this study is to develop a likert-style reliable and valid scale in order to measure teachers’ level of willingness and adjustment to become school administrator. Before developing the scale, the literatur...
Investigation of Equating Error in Tests with Differential Item Functioning
In this study purposes to indicate the effect of the number of DIF items and the distribution of DIF items in these forms, which be equalized on equating error. Mean-mean, mean-standard deviation, Haebara and Stocking-Lo...
The Dif Identification in Constructed Response Items Using Partial Credit Model
The study was to identify the load, the type and the significance of differential item functioning (DIF) in constructed response item using the partial credit model (PCM). The data in the study were the students’ instrum...
The development of a self-efficacy scale for mathematical modeling competencies
Mathematical modeling has come into prominence during the last few decades in many countries’ mathematics teaching curricula. It combines real life situations with mathematical context. Although evaluating students’ math...