The impact of 3-option responses to multiple-choice questions on guessing strategies and cut score determinations
Journal Title: Journal of Advances in Medical Education and Professionalism - Year 2017, Vol 5, Issue 2
Abstract
Introduction: Research has asserted MCQ items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional MCQ item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). Some medical educators have also adopted the practice of using 3-option responses on MCQ exams as a response to the difficulty experienced in generating additional plausible distractors. To date, however, little work has explored how 3-option responses might impact validity threats stemming from random guessing strategies, and what impact 3-option responses might have on cut-score determinations, particularly in the context of medical education classroom assessments. The purpose of this work is to further explore these critically important considerations that largely have gone ignored in the medical education literature to this point. Methods: A cumulative binomial distribution formula was used to calculate the probability that an examinee will answer at random a given number of items correctly on any exam (of any length). By way of a demonstration, a variety of scenarios were presented to illustrate how examination length and the number of response options impact examinees’ chances of passing a given examination, and how subsequent cut-score decisions may be impacted by these factors. Results: As a general rule, classroom assessments containing fewer items should utilize traditional 4-option or 5-option responses, whereas assessments of greater length are afforded greater flexibility in potentially utilizing 3-option responses. Conclusions: More research on items with 3-option responses is needed to better understand what value, if any, 3-option responses truly add to classroom assessments, and in what contexts potential benefits might be discernible.
Authors and Affiliations
KENNETH D. ROYAL, MYRAH R. STOCKDALE
Keywords
Related Articles
- EP ID EP235788
- DOI -
- Views 69
- Downloads 0
Pedagogical mediation using the virtual learning environment and the new generation: A search for improved performance in medical education
Introduction: Medical schools face increasing challenges to accommodate new health care needs. However, little has changed regarding the students’ education. In addition, educators face the challenge of improving their t...
Evaluation of information literacy status among medical students at Shiraz University of Medical Sciences
Introduction: The information literacy status and the use of information technology among students in the globalization age of course plans are very momentous. This study aimed to evaluate the information literacy status...
Assessing clinical reasoning skills using Script Concordance Test (SCT) and extended matching questions (EMQs): A pilot for urology trainees
Introduction: Clinical reasoning skill is the core of medical competence. Commonly used assessment methods for medical competence have limited ability to evaluate critical thinking and reasoning skills. Script Concordanc...
Interdisciplinary and inter-institutional differences in learning preferences among Malaysian medical and health sciences students
Introduction: The learner-centred approach in medical and health sciences education makes the study of learning preferences relevant and important. This study aimed to investigate the interdisciplinary, interinstitutiona...
Presenting the students’ academic achievement causal model based on goal orientation
Introduction: Several factors play a role in academic achievement, individual’s excellence and capability to do actions and tasks that the learner is in charge of in learning areas. The main goal of this study was to pre...