Scoring Short Answer Questions of Five Borderline Medical Students
Journal Title: Journal of Advances in Medicine and Medical Research - Year 2016, Vol 17, Issue 12
Abstract
Background: The assessment of medical knowledge is integral to becoming a medical practitioner in Australia, and Short Answer Questions (SAQs) are frequently used in this process. This paper compares the use of Classical Test Theory (CTT) and the Rasch rating scale measurement framework in scoring SAQs to evaluate the competence of borderline candidates in Australian medical students. Aims: The aim of this study was to utilise two scoring paradigms to compare the results of borderline medical students on SAQs. Methods: Forty SAQs were administered to 140, fifth year medical students at an Australian university in an online practice examination. Aligned with CTT, each student’s performance was expressed as the sum of the question scores. The data was then also analysed within the Rasch rating scale measurement framework and measures of performance were obtained. The two sets of results were compared across borderline students. Results: According to CTT, five students were identified as being exactly at the pass mark of 50 per cent. Rasch analysis indicated however that although the students had the same ability estimates, their approach to answering SAQs were vastly different, altering the interpretation of their overall performance. Conclusion: The sole use of CTT in the analysis of examination data may result in issues of validity and reliability when measuring clinical competence. The Rasch rating scale measurement framework may be invaluable in informing the analysis of performance in high stakes scenarios to ensure fair decisions of clinical competence.
Authors and Affiliations
Monique Trigg, John Barnard, Hannah Pham, Peter Devitt
Keywords
Related Articles
- EP ID EP341927
- DOI 10.9734/BJMMR/2016/29295
- Views 73
- Downloads 0
Facial Tissues Donation and Facial Transplantation: Knowledge Evaluation of the Population about this New Procedure
Background: Face transplantation is a complex procedure on a medical, moral and psychological point of view. Therefore, provides many benefits in improving aesthetic function and social integration. We evaluate the knowl...
Latent Viruses, Microcompetition, Transcription Factor Deficiency and the Cause of Acute Lymphoblastic Leukemia
The cause of B-cell Acute Lymphoblastic Leukemia (B-ALL) is unknown. Some studies suggested that the cause might be a deficiency in certain transcription factors due to a genetic deletion. We would like to propose a diff...
Salvaging an Endodontically Treated Mandibular Molar with a Furcation Perforation by Root Hemisection Followed by Fixed Prosthesis: A Case Report
Hemisection is the splitting of a two-rooted tooth into two separate portions. This process has also been called bicuspidization in the mandibular molar because it changes a molar into two separate bicuspids. A case invo...
Infant and Young Child Feeding in Children under-5 Years in Ghana: Key Strategy to Childhood Development
Aim: To explore the challenges mothers encounter during infant and young child feeding in children under-5 years and to make recommendations to overcome these challenges. This is paramount as feeding practices in childre...
Association between Major Non-communicable Diseases Risk Factors and Fasting Blood Glucose in Iran: Comparison of Two Techniques, with and Without Dichotomizing the Response
Background: Dichotomizing a continuous outcome variable is a common approach to estimate the odds ratio (OR) as a measure of association. In the present study we aimed to compare a non-dichotomizing technique with logist...