Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations

Journal Title: International Journal of Assessment Tools in Education - Year 2017, Vol 4, Issue 2

Abstract

This study intended to investigate the operations of various theory-based Differential Item Functioning (DIF) methods under different scoring situations. In this context, data obtained from conducting a Verbal Reasoning Skills Test (scored both in dichotomous and weighted scores) on 1593 individuals was examined via Mantel-Haenszel/Mantel, Standardization and Likelihood Ratio Test techniques and items that point to DIF and numbers of items with DIF for each technique and scoring situation were identified. Results show that Classical Test Theory (CTT) based DIF methods generally provided results that were consistent in themselves and that these results were not significantly different from each other. Agreement between techniques based on Item Response Theory (IRT) and Classical Test Theory (CTT) was found to be low under different scoring situations and results were significantly different from each other.

Authors and Affiliations

Hüseyin Selvi, Devrim Özdemir Alıcı

Keywords

Related Articles

Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches

This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA) and Rasch modeling, the authors investigate th...

Development of Self Directed Learning Skills Scale for Pre-Service Science Teachers

The aim of this study is to develop a valid and reliable instrument which is enable to assess pre-service teachers’ self-directed learning skills. 140 students included in this study for validity and reliability. Explora...

Development of the Teacher Candidates’ Level of being Affected from Public Personnel Selection Examination Scale

This study aimed to develop a scale to evaluate teacher candidates' level of being affected from the public personnel selection examination. The participants of the study consisted of the final year students at Pamukkale...

Are We Measuring Teachers’ Attitudes towards Computers in Detail?: Adaptation of a Questionnaire into Turkish Culture

Teachers’ perceptions of computers play an important role in integrating computers into education. The related literature includes studies developing or adapting a survey instrument in Turkish culture measuring teachers’...

Look Sir, I Drew You

The purpose of this study is to try to find out how the fifth, sixth, seventh and eighth graders perceive science teachers through the pictures they have drawn. A qualitative research method was used in the research. A t...

Download PDF file
  • EP ID EP235240
  • DOI 10.21449/ijate.334584
  • Views 173
  • Downloads 0

How To Cite

Hüseyin Selvi, Devrim Özdemir Alıcı (2017). Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations. International Journal of Assessment Tools in Education, 4(2), 223-239. https://europub.co.uk/articles/-A-235240