Halos and Horns in the Assessment of Undergraduate Medical Students: A Consistency-Based Approach
Journal Title: Journal of Applied Quantitative Methods - Year 2008, Vol 3, Issue 2
Abstract
The authors introduce a consistency-based approach to detecting examiner bias. On comparing intra-class correlation coefficients on transformed data for supervisor continuous performance and report marks (ICC1*) with those for supervisor continuous performance and second marker report marks (ICC2*), a highly significant difference was obtained for both the entire cohort (ICC1* = .72, ICC2* = .30, F = 2.47, p < .0005 (N = 1085)) and the subgroup with high supervisor ratings for continuous performance (ICC1* = .62, ICC2* = .24, F = 1.97, p < .0005 (n = 952)). A strong halo effect was detected and preliminary evidence was obtained for the presence of a strong horn effect for students with lower scores, thus providing a basis for future research.
Authors and Affiliations
Margaret MACDOUGALL, Simon RILEY, Helen CAMERON, Brian MCKINSTRY
Keywords
Related Articles
- EP ID EP124419
- DOI -
- Views 82
- Downloads 0
IMPACT OF EDUCATIONAL TEST FEATURES ON ITEM DIFFICULTIES BY THE LINEAR LOGISTIC TEST MODEL
The aim of the paper is to investigate the effect of item and person properties on item difficulties using the Linear Logistic Test Model (LLTM) and its extensions. The data under investigation are the Italy mathematics...
THE INVESTMENT IN EDUCATION AND IN CONTINUOUS TRAINING, AT EU-27 LEVEL
The fundamental role that education has in the development of human fundamental values is to form, nurture and develop spirit. The aim of this paper is to highlight the role of the investment in education and continuous...
Storage Optimization of Educational System Data
There are described methods used to minimize data files dimension. There are defined indicators for measuring size of files and databases. The storage optimization process is based on selecting from a multitude of data s...
A Non-Parametric Test for a Change-Point in Linear Profile Data
We propose a change-point approach for testing the constancy of regression parameters in a linear profile data set (panel data in econometrics). Each sample collected over time in the historical data set consists of sev...
FINANCIAL BEHAVIOR OF ROMANIANS - PRELIMINARY ISSUES OF THE HOUSEHOLD BUDGET SURVEY WITH AN EXTENSION OF THE QUESTIONNAIRE
In the context of an unprecedented acceleration of the demographic ageing process the objective of financial stability at different levels of the economy needs economic and social measures that are based on scientific gr...