Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations
Journal Title: International Journal of Assessment Tools in Education - Year 2017, Vol 4, Issue 2
Abstract
This study intended to investigate the operations of various theory-based Differential Item Functioning (DIF) methods under different scoring situations. In this context, data obtained from conducting a Verbal Reasoning Skills Test (scored both in dichotomous and weighted scores) on 1593 individuals was examined via Mantel-Haenszel/Mantel, Standardization and Likelihood Ratio Test techniques and items that point to DIF and numbers of items with DIF for each technique and scoring situation were identified. Results show that Classical Test Theory (CTT) based DIF methods generally provided results that were consistent in themselves and that these results were not significantly different from each other. Agreement between techniques based on Item Response Theory (IRT) and Classical Test Theory (CTT) was found to be low under different scoring situations and results were significantly different from each other.
Authors and Affiliations
Hüseyin Selvi, Devrim Özdemir Alıcı
Keywords
Related Articles
- EP ID EP235240
- DOI 10.21449/ijate.334584
- Views 150
- Downloads 0
The Influence of Item Formats when Locating a Student on a Learning Progression in Science
Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning p...
The Effect of School Efficiency on Student Achievement
This study was conducted to determine the effect of school efficiency of secondary schools on student achievement based on the views of teachers. A scale was prepared in line with the aims of the study, and this scale wa...
Investigating the Impact of Missing Data Handling Methods on the Detection of Differential Item Functioning
In this study, it is aimed to investigate the impact of different missing data handling methods on the detection of Differential Item Functioning methods (Mantel Haenszel and Standardization methods based on Classical Te...
Development of the Teacher Candidates’ Level of being Affected from Public Personnel Selection Examination Scale
This study aimed to develop a scale to evaluate teacher candidates' level of being affected from the public personnel selection examination. The participants of the study consisted of the final year students at Pamukkale...
Development of “Willingness to Become School Administrator and Adjustment Scale”
The purpose of this study is to develop a likert-style reliable and valid scale in order to measure teachers’ level of willingness and adjustment to become school administrator. Before developing the scale, the literatur...