Scoring Short Answer Questions of Five Borderline Medical Students
Journal Title: Journal of Advances in Medicine and Medical Research - Year 2016, Vol 17, Issue 12
Abstract
Background: The assessment of medical knowledge is integral to becoming a medical practitioner in Australia, and Short Answer Questions (SAQs) are frequently used in this process. This paper compares the use of Classical Test Theory (CTT) and the Rasch rating scale measurement framework in scoring SAQs to evaluate the competence of borderline candidates in Australian medical students. Aims: The aim of this study was to utilise two scoring paradigms to compare the results of borderline medical students on SAQs. Methods: Forty SAQs were administered to 140, fifth year medical students at an Australian university in an online practice examination. Aligned with CTT, each student’s performance was expressed as the sum of the question scores. The data was then also analysed within the Rasch rating scale measurement framework and measures of performance were obtained. The two sets of results were compared across borderline students. Results: According to CTT, five students were identified as being exactly at the pass mark of 50 per cent. Rasch analysis indicated however that although the students had the same ability estimates, their approach to answering SAQs were vastly different, altering the interpretation of their overall performance. Conclusion: The sole use of CTT in the analysis of examination data may result in issues of validity and reliability when measuring clinical competence. The Rasch rating scale measurement framework may be invaluable in informing the analysis of performance in high stakes scenarios to ensure fair decisions of clinical competence.
Authors and Affiliations
Monique Trigg, John Barnard, Hannah Pham, Peter Devitt
Keywords
Related Articles
- EP ID EP341927
- DOI 10.9734/BJMMR/2016/29295
- Views 82
- Downloads 0
Prevalence of Pulmonary Tuberculosis among Inmates and Staff of Three Indian Prisons
Aim: To estimate prevalence of TB among inmates and staff of three prisons in south India. Place of Study: The study was undertaken in three purposively selected prisons in Karnataka State, India, namely, Belgaum, Myso...
Patients with Abdominal Aortic Aneurysm Demonstrate Higher Levels of Non-cholesterol Sterol Markers of Endogenous Cholesterol Synthesis
Aims: To establish the levels of selected non-cholesterol sterols in patients with abdominal aortic aneurysm (AAA) and to compare them with levels in non-AAA patients treated for lipid metabolism disorder. To compare the...
Determinants of Male Partner Involvement in Antenatal Care in Wakiso District, Uganda
Aims: In spite of its associated positive outcomes for maternal and child health, male partner involvement continues to be low in Uganda. This study sought to assess determinants of male involvement (MI) in antenatal car...
Mentoring Prevalence and Need among Pre-clinical and Clinical Medical and Dental Students in a Nigerian University
Aims: Having a mentor is critical to having a successful career. Despite the known benefits of mentoring, studies have shown a low prevalence among students in the medical and dental schools particularly in developing co...
Metabolic Syndrome: Modification of the Fatty Acid Composition and Glucose-insulin Homeostasis
Objective: Metabolic syndrome is a widespread disease associated with cardiovascular pathologies and diabetes mellitus. The underlying mechanisms for development of the metabolic syndrome are currently being intensively...