Use of Full Hierarchy Consistency Index to Assess Response Consistency
Journal Title: International Journal of Assessment Tools in Education - Year 2018, Vol 5, Issue 1
Abstract
Measurement models need to properly delineate the real aspect of examinees’ response processes for measurement accuracy purposes. To avoid invalid inferences, fit of examinees’ response data to the model is studied through person-fit statistics. Misfit between the examinee response data and measurement model may be due to invalid models and/or examinee’s aberrant response behavior such as cheating, creative responding, and random responding. Hierarchy consistency index (HCI) was introduced as a person-fit statistics to assess classification reliability of particular cognitive diagnosis models. This study examines the HCI in terms of its usefulness under nonhierarchical attribute conditions and under different item types. Moreover, current form of HCI formulation only considers the information based on correct answers only. We argue and demonstrate that more information could be obtained by incorporating the information that may be obtained from incorrect responses. Therefore, this study considers the full version of the HCI (i.e., FHCI). Results indicate that current form of HCI is sensitive to misfitting item types (i.e., basic or more complex) and examinee attribute patterns. In other words, HCI is affected by the attribute pattern an examinee has as well as by the item s/he aberrantly responded. Yet, FHCI is not severely affected by item types under any examinee attribute pattern.
Authors and Affiliations
Lokman Akbay
Keywords
Related Articles
- EP ID EP262163
- DOI 10.21449/ijate.350499
- Views 140
- Downloads 0
Evaluating the Comparability of PPT and CBT by Implementing the Compulsory Islamic Culture Course Test in Jordan University
Study aims to determine whether the university students' scores in the compulsory Islamic culture course test on a selected sample differ across the paper-and pencil test (PPT) & computer-based test (CBT) versions, and t...
Are We Measuring Teachers’ Attitudes towards Computers in Detail?: Adaptation of a Questionnaire into Turkish Culture
Teachers’ perceptions of computers play an important role in integrating computers into education. The related literature includes studies developing or adapting a survey instrument in Turkish culture measuring teachers’...
The Opinions of Primary Teacher Candidates towards Evaluation Performances of Instructors
The knowledge and experience gained in the higher education stage with professional instructors who are one of the most important elements of the process for the individual. Because of this, the instructor of the class...
The Development of a General Disaster Preparedness Belief Scale Using the Health Belief Model as a Theoretical Framework
The Health Belief Model (HBM) is one of the oldest and most recognized conceptual framework of health behavior and can be applied to disaster preparedness efforts which focus predominantly on human behavior. The study ai...
Middle School Mathematics Teachers' Opinions on Feedback
During instruction, providing feedbacks improves students’ academic achievements as well as motivates them to actively engage in lesson activities. Feedback is very important for teaching. Feedback is not only a function...