Use of Full Hierarchy Consistency Index to Assess Response Consistency
Journal Title: International Journal of Assessment Tools in Education - Year 2018, Vol 5, Issue 1
Abstract
Measurement models need to properly delineate the real aspect of examinees’ response processes for measurement accuracy purposes. To avoid invalid inferences, fit of examinees’ response data to the model is studied through person-fit statistics. Misfit between the examinee response data and measurement model may be due to invalid models and/or examinee’s aberrant response behavior such as cheating, creative responding, and random responding. Hierarchy consistency index (HCI) was introduced as a person-fit statistics to assess classification reliability of particular cognitive diagnosis models. This study examines the HCI in terms of its usefulness under nonhierarchical attribute conditions and under different item types. Moreover, current form of HCI formulation only considers the information based on correct answers only. We argue and demonstrate that more information could be obtained by incorporating the information that may be obtained from incorrect responses. Therefore, this study considers the full version of the HCI (i.e., FHCI). Results indicate that current form of HCI is sensitive to misfitting item types (i.e., basic or more complex) and examinee attribute patterns. In other words, HCI is affected by the attribute pattern an examinee has as well as by the item s/he aberrantly responded. Yet, FHCI is not severely affected by item types under any examinee attribute pattern.
Authors and Affiliations
Lokman Akbay
Keywords
Related Articles
- EP ID EP262163
- DOI 10.21449/ijate.350499
- Views 133
- Downloads 0
The Opinions of Primary Teacher Candidates towards Evaluation Performances of Instructors
The knowledge and experience gained in the higher education stage with professional instructors who are one of the most important elements of the process for the individual. Because of this, the instructor of the class...
Exploring Teachers’ Assessment Practices and Skills
The need for increased use of test results to improve educational outcomes is urgent; yet, there is little understanding in the research literature of practitioners’ knowledge and skills in interpreting and using educati...
Formative Assessment in Teaching the Macedonian Language (Primary Education in R. Macedonia)
In the Republic of Macedonia, the formative assessment represents a new assessment paradigm that focuses on students as active participants during the teaching process. This paradigm was established in 2007 as part of th...
Perceptions of Organizational Politics Scale (POPS) Questionnaire into Turkish: A Validity and Reliability Study
In this study it was aimed to make the studies of the translation of Perception of Organizational Politics Scale into Turkish and the validity and reliability of the scale. Perceptions of Organizational Politics Scale’s...
Using the 2006 PISA Questionaire to Evaluate the Measure of Educational Resources: A Rasch Measurement Approach
School educational resources are key when studying school improvement due to their influence on learning outcomes. Because of this, careful attention should be given to the way educational resources are operationalized a...