Assessing clinical reasoning skills using Script Concordance Test (SCT) and extended matching questions (EMQs): A pilot for urology trainees
Journal Title: Journal of Advances in Medical Education and Professionalism - Year 2019, Vol 7, Issue 1
Abstract
Introduction: Clinical reasoning skill is the core of medical competence. Commonly used assessment methods for medical competence have limited ability to evaluate critical thinking and reasoning skills. Script Concordance Test (SCT) and Extended Matching Questions (EMQs) are the evolving tests which are considered to be valid and reliable tools for assessing clinical reasoning and judgment. We performed this pilot study to determine whether SCT and EMQs can differentiate clinical reasoning ability among urology residents, interns and medical students. Methods: This was a cross-sectional study in which an examination with 48 SCT-based items on eleven clinical scenarios and four themed EMQs with 21 items were administered to a total of 27 learners at three differing levels of experience i.e. 9 urology residents, 6 interns and 12 fifth year medical students. A non-probability convenience sampling was done. The SCTs and EMQs were developed from clinical situations representative of urological practice by 5 content experts (urologists) and assessed by a medical education expert. Learners’ responses were scored using the standard and the graduated key. A one way analysis of variance (ANOVA) was conducted to compare the mean scores across the level of experience. A p-value of <0.05 was considered statistically significant. Test reliability was estimated by Cronbach α. A focused group discussion with candidates was done to assess their perception of test. Results: Both SCT and EMQs successfully differentiated residents from interns and students. Statistically significant difference in mean score was found for both SCT and EMQs among the 3 groups using both the standard and the graduated key. The mean scores were higher for all groups as measured by the graduated key compared to the standard key. The internal consistency (Cronbach’s α) was 0.53 and 0.6 for EMQs and SCT, respectively. Majority of the participants were satisfied with regard to time, environment, instructions provided and the content covered and nearly all felt that the test helped them in thinking process particularly clinical reasoning. Conclusion: Our data suggest that both SCT and EMQs are capable of discriminating between learners according to their clinical experience in urology. As there is a wide acceptability by all candidates, these tests could be used to assess and enhance clinical reasoning skills. More research is needed to prove validity of these tests.
Authors and Affiliations
SYED MUHAMMAD NAZIM, JAMSHEER J TALATI, SHEILA PINJANI, SYED RAZIUDDIN BIYABANI, MUHAMMAD HAMMAD ATHER, JOHN J. NORCINI
Keywords
Related Articles
- EP ID EP663196
- DOI 10.30476/jamp.2019.41038
- Views 108
- Downloads 0
The effect of test-enhanced spaced learning on the otolaryngology board and annual examination results: A quasi-experimental study
Introduction: In the test-enhanced spaced learning, educational contents are presented in small packages of well-developed test questions with a defined frequency to the learners. It is not clear that applying this educa...
Vertical integration in the teaching of final year medical students
Dear Editor, The traditional approach to medical education has been dichotomous, with a lack of integration between basic sciences and clinical medicine (1). Recent reforms have called for individualizing the learning pr...
Social accountable medical education: a concept analysis
Introduction: Considering the pervasiveness of social accountable medical education concept around the world and the growing trend of literature in this regard as well as various interpretations made about this concept,...
The influence of role-modeling on clinical empathy of medical interns: A qualitative study
Introduction: Clinical empathy ascertains the quality of doctorpatient relationship and entails beneficial outcomes for both parties. Role-modeling is a major factor in promoting clinical empathy skills of medical studen...
Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students
Introduction: Nowadays according to competency based curriculum, selecting an appropriate assessment method is inevitable. This study aimed to investigate application of Direct Observation of Procedural Skills (DOPS) in...