Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations

Journal Title: International Journal of Assessment Tools in Education - Year 2017, Vol 4, Issue 2

Abstract

This study intended to investigate the operations of various theory-based Differential Item Functioning (DIF) methods under different scoring situations. In this context, data obtained from conducting a Verbal Reasoning Skills Test (scored both in dichotomous and weighted scores) on 1593 individuals was examined via Mantel-Haenszel/Mantel, Standardization and Likelihood Ratio Test techniques and items that point to DIF and numbers of items with DIF for each technique and scoring situation were identified. Results show that Classical Test Theory (CTT) based DIF methods generally provided results that were consistent in themselves and that these results were not significantly different from each other. Agreement between techniques based on Item Response Theory (IRT) and Classical Test Theory (CTT) was found to be low under different scoring situations and results were significantly different from each other.

Authors and Affiliations

Hüseyin Selvi, Devrim Özdemir Alıcı

Keywords

Related Articles

Developmental Mathematics Students: Who are They and What is Their Mathematics Self-Efficacy?

The purpose of this quantitative study was to determine differences in developmental mathematics students’ self-efficacy within the demographic data from the survey. Data from a sample of 240 Intermediate Algebra student...

Look Sir, I Drew You

The purpose of this study is to try to find out how the fifth, sixth, seventh and eighth graders perceive science teachers through the pictures they have drawn. A qualitative research method was used in the research. A t...

The Validity and Reliability Study of Revised School Climate Teacher Survey’s Turkish Version

It is aimed to adapt Revised School Climate Teacher Survey (RSCTS) which is developed with a character education perspective to Turkish and assess its psychometrics properties in this study. This study is an instrument a...

Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation

This study utilized the Rasch model to assess the quality of a survey instrument designed to measure attitudes of administrators and teachers concerning a differentiated teacher compensation program piloted in Kentucky....

Development of “Willingness to Become School Administrator and Adjustment Scale”

The purpose of this study is to develop a likert-style reliable and valid scale in order to measure teachers’ level of willingness and adjustment to become school administrator. Before developing the scale, the literatur...

Download PDF file
  • EP ID EP235240
  • DOI 10.21449/ijate.334584
  • Views 126
  • Downloads 0

How To Cite

Hüseyin Selvi, Devrim Özdemir Alıcı (2017). Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations. International Journal of Assessment Tools in Education, 4(2), 223-239. https://europub.co.uk/articles/-A-235240