Item Analysis of Multiple Choice Questions at the Department of Paediatrics, Arabian Gulf University, Manama, Bahrain
Journal Title: Sultan Qaboos University Medical Journal - Year 2018, Vol 18, Issue 1
Abstract
Objectives: The current study aimed to carry out a post-validation item analysis of multiple choice questions (MCQs) in medical examinations in order to evaluate correlations between item difficulty, item discrimination and distraction effectiveness so as to determine whether questions should be included, modified or discarded. In addition, the optimal number of options per MCQ was analysed. Methods: This cross-sectional study was performed in the Department of Paediatrics, Arabian Gulf University, Manama, Bahrain. A total of 800 MCQs and 4,000 distractors were analysed between November 2013 and June 2016. Results: The mean difficulty index ranged from 36.70–73.14%. The mean discrimination index ranged from 0.20–0.34. The mean distractor efficiency ranged from 66.50–90.00%. Of the items, 48.4%, 35.3%, 11.4%, 3.9% and 1.1% had zero, one, two, three and four nonfunctional distractors (NFDs), respectively. Using three or four rather than five options in each MCQ resulted in 95% or 83.6% of items having zero NFDs, respectively. The distractor efficiency was 91.87%, 85.83% and 64.13% for difficult, acceptable and easy items, respectively (P <0.005). Distractor efficiency was 83.33%, 83.24% and 77.56% for items with excellent, acceptable and poor discrimination, respectively (P <0.005). The average Kuder- Richardson formula 20 reliability coefficient was 0.76. Conclusion: A considerable number of the MCQ items were within acceptable ranges. However, some items needed to be discarded or revised. Using three or four rather than five options in MCQs is recommended to reduce the number of NFDs and improve the overall quality of the examination.
Authors and Affiliations
Deena Kheyami, Ahmed Jaradat, Tareq Al-Shibani, Fuad A. Ali
Keywords
Related Articles
- EP ID EP22860
- DOI 10.18295/squmj.2018.18.01.011
- Views 304
- Downloads 16
Hearing Improvement after Partial Labyrinthectomy Resection of petrous apex cholesterol granuloma
We present the case of a 57 year-old male presenting with symptomatic petrous apex cholesterol granuloma, multiple cranial nerve weaknesses and deafness of the left ear. Te chosen intervention was a cholesterol granulo...
Erratum Notice of Author Affiliation Correction: Point-of-Care Airway Ultrasonography Prior to an Emergency Cricothyroidotomy: Case report
Te Editors of Sultan Qaboos University Medical Journal (SQUMJ) have been informed that the authors of an article by Iqhbal et al. in the May 2018 issue of SQUMJ wish to make a correction to the afliation details of the...
Re: Controversies in Odontogenic Tumours Review
We read with great interest the recent review article by Siwach et al. published in the August 2017 issue of SQUMJ.1 We congratulate the authors on their elaborative narrative review of the controversies regarding vario...
2nd National Public Health Symposium Food and Nutrition for a Healthy Planet Oman Public Health Society, 18 October 2014
Recurrent Urinary Tract Infections Management in Women A review
Urinary tract infections (UTIs) are one of the most frequent clinical bacterial infections in women, accounting for nearly 25% of all infections. Around 50–60% of women will develop UTIs in their lifetimes. Escherich...