Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students
Journal Title: Journal of Advances in Medical Education and Professionalism - Year 2018, Vol 6, Issue 3
Abstract
Introduction: Nowadays according to competency based curriculum, selecting an appropriate assessment method is inevitable. This study aimed to investigate application of Direct Observation of Procedural Skills (DOPS) in undergraduate medical students. Methods: This is a cross sectional study conducted during emergency ward rotation in last year medical students using consensus sampling method. Each student performed 2 procedures at least twice under the observation of 2 assessors using modified DOPS rating scales designed for each procedure simultaneously. Correlation between DOPS score and final routine exam was measured. Face and content validity was determined by the panel of experts. Moreover, through the test-retest and interrater reliability, the correlation of each score and total score was investigated. The spent time was calculated too. The statistical analysis was carried out using SPSS version 18. Results: Totally 60 students did 240 procedures under DOPS. The face and content validity confirmed by an expert panel. The findings showed that there was a significant correlation between the scores of each test and the total DOPS score (r1=0.736**, r2=0.793**, r3=0.564**, r4=0.685**; p<0.001). There was a significant correlation between the first and second scores of doing the same procedure (Pearson Cor.=0.74, p<0.001) and also between the scores of the two individual examiners when observing the same procedure (Pearson Cor.=0.84-0.94, p<0.001). The results showed that there was no correlation (Pearson Correlation=0.018, p<0.89) between the scores of this test and the final routine ward exam scores. The average time for doing DOPS test and the average time for providing feedback were 11.17±7.5 Max and 9.2±4.5 Min, respectively. Conclusion: The use of novel performance assessment methods such as DOPS is highly beneficial in order to ensure the adequacy of learning in medical students and assess their readiness for accepting professional responsibilities. DOPS as a practical and reliable test with acceptable validation can be used to assess clinical skills of undergraduate medical students.
Authors and Affiliations
AREZOU FARAJPOUR, MITRA AMINI, ELHAM PISHBIN, ZAHRA MOSTAFAVIAN, SOMAYEH AKBARI FARMAD
Keywords
Related Articles
- EP ID EP343980
- DOI -
- Views 62
- Downloads 0
The influence of role-modeling on clinical empathy of medical interns: A qualitative study
Introduction: Clinical empathy ascertains the quality of doctorpatient relationship and entails beneficial outcomes for both parties. Role-modeling is a major factor in promoting clinical empathy skills of medical studen...
Interdisciplinary and inter-institutional differences in learning preferences among Malaysian medical and health sciences students
Introduction: The learner-centred approach in medical and health sciences education makes the study of learning preferences relevant and important. This study aimed to investigate the interdisciplinary, interinstitutiona...
Effect of formative evaluation using direct observation of procedural skills in assessment of postgraduate students of obstetrics and gynecology: Prospective study
Introduction: Direct Observation of Procedural Skills (DOPS) is a way of evaluating procedural skills through observation in the workplace. The purpose of this study was to assess the role of DOPS in teaching and assessm...
Program evaluation of an integrated basic science medical curriculum in Shiraz Medical School, using CIPP evaluation model
Introduction: In recent years curriculum reform and integration was done in many medical schools. The integrated curriculum is a popular concept all over the world. In Shiraz medical school, the reform was initiated by s...
Intangibility of the invisible hand – Analysing the micro-dynamics of novice mentoring program based upon one institutional experience
Although mentoring has been regarded as an essential component in the developmental phase of medical students, it is the nature of hierarchical relationship and the quality of emotional exchange which determine its susta...