A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions

Journal Title: International Journal of Assessment Tools in Education - Year 2015, Vol 2, Issue 1

Abstract

This study investigated the effectiveness of logistic regression models to detect uniform and non-uniform DIF in polytomous items across small sample sizes and non-normality of ability distributions. A simulation study was used to compare three logistic regression models, which were the cumulative logits model, the continuation ratio model, and the adjacent categories model. The results revealed that logistic regression was a powerful method to detect DIF in polytomous items, but not useful to distinguish the type of DIF. Continuation ratio model worked best to detect uniform DIF, but the cumulative logits model gave more acceptable type I error results. As sample size increased, type I errors increased at cumulative logits model results. Skewness of ability distributions reduced power of logistic regression to detect non-uniform DIF. Small sample sizes reduced power of logistic regression.

Authors and Affiliations

Yasemin KAYA, Walter L. LEITE, M. David MILLER

Keywords

Related Articles

Development of the rubric self-efficacy scale

The purpose of this study is to develop a valid and reliable measurement tool determining teachers’ self-efficacy regarding rubrics. Especially in educational environments, rubrics are measurement tools used in the asses...

Inquiry Based Learning and Its Effectiveness

The aim of this study is to investigate the effectiveness of the inquiry based learning on the skills of the prospective teachers for the laboratory applications I course activities related to the developed chemistry exp...

The Development Study of Thoughts Scale Towards Measurement and Assessment Course on High Education

Considering that measurement and assessment, the most critical component of the education process, should be properly carried out by educators, it is necessary to make sure that education faculties deliver the measuremen...

Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations

This study intended to investigate the operations of various theory-based Differential Item Functioning (DIF) methods under different scoring situations. In this context, data obtained from conducting a Verbal Reasoning...

Perceptions of Organizational Politics Scale (POPS) Questionnaire into Turkish: A Validity and Reliability Study

In this study it was aimed to make the studies of the translation of Perception of Organizational Politics Scale into Turkish and the validity and reliability of the scale. Perceptions of Organizational Politics Scale’s...

Download PDF file
  • EP ID EP174037
  • DOI -
  • Views 152
  • Downloads 0

How To Cite

Yasemin KAYA, Walter L. LEITE, M. David MILLER (2015). A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions. International Journal of Assessment Tools in Education, 2(1), 22-39. https://europub.co.uk/articles/-A-174037