Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches
Journal Title: International Journal of Assessment Tools in Education - Year 2016, Vol 3, Issue 1
Abstract
This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA) and Rasch modeling, the authors investigate the (a) an overall assessment of dimensionality using EFA, (b) a secondary assessment of dimensionality using a principal components analysis (PCA) of the residuals when the items are fit to the Rasch model, and (c) an assessment of item-level properties using item-level statistics provided when the items are fit to the Rasch model. The results support the usage of the scale as a supplement to high-stakes decision making such as tenure. However, the lack of precise targeting of item difficulty to person ability combined with the low person separation index renders rank-ordering professors according to minuscule differences in overall subscale scores a highly questionable practice.
Authors and Affiliations
Kelly D. Bradley, Eric M. Snyder, Angela K. Tombari
Keywords
Related Articles
- EP ID EP174026
- DOI -
- Views 153
- Downloads 0
Developmental Mathematics Students: Who are They and What is Their Mathematics Self-Efficacy?
The purpose of this quantitative study was to determine differences in developmental mathematics students’ self-efficacy within the demographic data from the survey. Data from a sample of 240 Intermediate Algebra student...
Investigation of Equating Error in Tests with Differential Item Functioning
In this study purposes to indicate the effect of the number of DIF items and the distribution of DIF items in these forms, which be equalized on equating error. Mean-mean, mean-standard deviation, Haebara and Stocking-Lo...
Are We Measuring Teachers’ Attitudes towards Computers in Detail?: Adaptation of a Questionnaire into Turkish Culture
Teachers’ perceptions of computers play an important role in integrating computers into education. The related literature includes studies developing or adapting a survey instrument in Turkish culture measuring teachers’...
The Colorado Learning Attitudes about Science Survey (CLASS): The Study of Validity and Reliability
The aim of this research is to adapt the Colorado Learning Attitudes about Science Survey (Adams et al., 2006) to Turkish and to examine its psychometric properties. The research was conducted on 400 9th grade students f...
Investigation of 9th Grade High School Students’ Attitudes towards Science Course
In this study, ninth grade students’ attitudes towards science were investigated in terms of self-regulation strategies, motivational beliefs and gender variables. The sample of this study includes 322 male and 296 femal...