Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches
Journal Title: International Journal of Assessment Tools in Education - Year 2016, Vol 3, Issue 1
Abstract
This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA) and Rasch modeling, the authors investigate the (a) an overall assessment of dimensionality using EFA, (b) a secondary assessment of dimensionality using a principal components analysis (PCA) of the residuals when the items are fit to the Rasch model, and (c) an assessment of item-level properties using item-level statistics provided when the items are fit to the Rasch model. The results support the usage of the scale as a supplement to high-stakes decision making such as tenure. However, the lack of precise targeting of item difficulty to person ability combined with the low person separation index renders rank-ordering professors according to minuscule differences in overall subscale scores a highly questionable practice.
Authors and Affiliations
Kelly D. Bradley, Eric M. Snyder, Angela K. Tombari
Keywords
Related Articles
- EP ID EP174026
- DOI -
- Views 145
- Downloads 0
Developing a Proof-of-Concept Selection Test for Entry into Primary Teacher Education Programs
The purpose of the study is to measure students' performance through different measurement tools and compare the findings through G Theory in order to identify the errors associated with the raters and items to improve t...
Investigation of 9th Grade High School Students’ Attitudes towards Science Course
In this study, ninth grade students’ attitudes towards science were investigated in terms of self-regulation strategies, motivational beliefs and gender variables. The sample of this study includes 322 male and 296 femal...
Assessing Metacognition: Theory and Practices
Many researchers in education emphasized students’ metacognition should be fostered for academic development and achievement. However, to support students’ metacognitive development and adequacy appropriately, their meta...
Prospective Teachers’ Tendencies to Utilize From the Facilities of Contemporary Educational Technology
In terms of effectiveness and efficiency, it is important to determine the views of prospective teachers related to taking advantage of the facilities of contemporary educational technology. This study which aims to iden...
Development of the rubric self-efficacy scale
The purpose of this study is to develop a valid and reliable measurement tool determining teachers’ self-efficacy regarding rubrics. Especially in educational environments, rubrics are measurement tools used in the asses...