Scoring Short Answer Questions of Five Borderline Medical Students
Journal Title: Journal of Advances in Medicine and Medical Research - Year 2016, Vol 17, Issue 12
Abstract
Background: The assessment of medical knowledge is integral to becoming a medical practitioner in Australia, and Short Answer Questions (SAQs) are frequently used in this process. This paper compares the use of Classical Test Theory (CTT) and the Rasch rating scale measurement framework in scoring SAQs to evaluate the competence of borderline candidates in Australian medical students. Aims: The aim of this study was to utilise two scoring paradigms to compare the results of borderline medical students on SAQs. Methods: Forty SAQs were administered to 140, fifth year medical students at an Australian university in an online practice examination. Aligned with CTT, each student’s performance was expressed as the sum of the question scores. The data was then also analysed within the Rasch rating scale measurement framework and measures of performance were obtained. The two sets of results were compared across borderline students. Results: According to CTT, five students were identified as being exactly at the pass mark of 50 per cent. Rasch analysis indicated however that although the students had the same ability estimates, their approach to answering SAQs were vastly different, altering the interpretation of their overall performance. Conclusion: The sole use of CTT in the analysis of examination data may result in issues of validity and reliability when measuring clinical competence. The Rasch rating scale measurement framework may be invaluable in informing the analysis of performance in high stakes scenarios to ensure fair decisions of clinical competence.
Authors and Affiliations
Monique Trigg, John Barnard, Hannah Pham, Peter Devitt
Keywords
Related Articles
- EP ID EP341927
- DOI 10.9734/BJMMR/2016/29295
- Views 70
- Downloads 0
Neuro-epidemiology of Acute Stroke Syndrome in the Adult Emergency Department of a Tertiary Hospital in a Resource-limited Environment of South-eastern Nigeria
Background: Globally, acute stroke is one of the leading causes of preventable emergency hospital admissions. It is emerging as an important cause of disability and mortality among adult Nigerian Africans in the emergenc...
Platelet-rich Fibrin Formation was delayed in Plastic Tubes
Introduction: Platelet-rich fibrin (PRF) is used in many regenerative treatments. Preparing PRF in glass tubes requires quick handling and generates biohazard concerns about silica contamination and glass breakage. Using...
Preliminary Study of the Possible Benefit of the Reversible Acetylcholinesterase Inhibitor Donepezil for Cognitive Impairment Associated with Corticorticosteroid Treatment for Presumptive Neurosarcoidsosis with a Lesion in the Right Basal Ganglia and Thalamus
Aims: To present the case of a patient diagnosed by neurology with neurosarcoidsosis with cognitive impairment after long-term treatment with corticosteroids who showed marked improvement in his cognition upon initiation...
Acute Hepatic Insufficiency Disclosing Congenital Syphilis in a Neonate
Congenital syphilis is a maternal-fetal infection caused by Treponema pallidum. Early signs are characteristic skin lesions, lymphadenopathy, hepatosplenomegaly, failure to thrive, blood-stained nasal discharge, perioral...
The Effects of Supervised Exercise Program on Health-Related Physical Fitness in Kuwait
Aims: Physical activity improves health in terms of cardiovascular fitness, musculo-skeletal fitness, body composition, and metabolism. The study aims to examine the effects of supervised exercise training on metabolic p...