Use of Full Hierarchy Consistency Index to Assess Response Consistency
Journal Title: International Journal of Assessment Tools in Education - Year 2018, Vol 5, Issue 1
Abstract
Measurement models need to properly delineate the real aspect of examinees’ response processes for measurement accuracy purposes. To avoid invalid inferences, fit of examinees’ response data to the model is studied through person-fit statistics. Misfit between the examinee response data and measurement model may be due to invalid models and/or examinee’s aberrant response behavior such as cheating, creative responding, and random responding. Hierarchy consistency index (HCI) was introduced as a person-fit statistics to assess classification reliability of particular cognitive diagnosis models. This study examines the HCI in terms of its usefulness under nonhierarchical attribute conditions and under different item types. Moreover, current form of HCI formulation only considers the information based on correct answers only. We argue and demonstrate that more information could be obtained by incorporating the information that may be obtained from incorrect responses. Therefore, this study considers the full version of the HCI (i.e., FHCI). Results indicate that current form of HCI is sensitive to misfitting item types (i.e., basic or more complex) and examinee attribute patterns. In other words, HCI is affected by the attribute pattern an examinee has as well as by the item s/he aberrantly responded. Yet, FHCI is not severely affected by item types under any examinee attribute pattern.
Authors and Affiliations
Lokman Akbay
Keywords
Related Articles
- EP ID EP262163
- DOI 10.21449/ijate.350499
- Views 113
- Downloads 0
Developing a Proof-of-Concept Selection Test for Entry into Primary Teacher Education Programs
The purpose of the study is to measure students' performance through different measurement tools and compare the findings through G Theory in order to identify the errors associated with the raters and items to improve t...
Development of the rubric self-efficacy scale
The purpose of this study is to develop a valid and reliable measurement tool determining teachers’ self-efficacy regarding rubrics. Especially in educational environments, rubrics are measurement tools used in the asses...
The Dif Identification in Constructed Response Items Using Partial Credit Model
The study was to identify the load, the type and the significance of differential item functioning (DIF) in constructed response item using the partial credit model (PCM). The data in the study were the students’ instrum...
Development of Self Directed Learning Skills Scale for Pre-Service Science Teachers
The aim of this study is to develop a valid and reliable instrument which is enable to assess pre-service teachers’ self-directed learning skills. 140 students included in this study for validity and reliability. Explora...
Inquiry Based Learning and Its Effectiveness
The aim of this study is to investigate the effectiveness of the inquiry based learning on the skills of the prospective teachers for the laboratory applications I course activities related to the developed chemistry exp...