The impact of 3-option responses to multiple-choice questions on guessing strategies and cut score determinations
Journal Title: Journal of Advances in Medical Education and Professionalism - Year 2017, Vol 5, Issue 2
Abstract
Introduction: Research has asserted MCQ items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional MCQ item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). Some medical educators have also adopted the practice of using 3-option responses on MCQ exams as a response to the difficulty experienced in generating additional plausible distractors. To date, however, little work has explored how 3-option responses might impact validity threats stemming from random guessing strategies, and what impact 3-option responses might have on cut-score determinations, particularly in the context of medical education classroom assessments. The purpose of this work is to further explore these critically important considerations that largely have gone ignored in the medical education literature to this point. Methods: A cumulative binomial distribution formula was used to calculate the probability that an examinee will answer at random a given number of items correctly on any exam (of any length). By way of a demonstration, a variety of scenarios were presented to illustrate how examination length and the number of response options impact examinees’ chances of passing a given examination, and how subsequent cut-score decisions may be impacted by these factors. Results: As a general rule, classroom assessments containing fewer items should utilize traditional 4-option or 5-option responses, whereas assessments of greater length are afforded greater flexibility in potentially utilizing 3-option responses. Conclusions: More research on items with 3-option responses is needed to better understand what value, if any, 3-option responses truly add to classroom assessments, and in what contexts potential benefits might be discernible.
Authors and Affiliations
KENNETH D. ROYAL, MYRAH R. STOCKDALE
Keywords
Related Articles
- EP ID EP235788
- DOI -
- Views 92
- Downloads 0
Dynamics of self-directed learning in M.Sc. nursing students: A qualitative research
Introduction: Working in the complex and ever changing healthcare settings forces the nurses and nursing students to be equipped with lifelong learning skills. One of the lifelong learning skills is self-directed learnin...
The applications of virtual reality technology in medical groups teaching
Introduction: Virtual reality is a new method for training different medical groups. Based on this technology, professionals and students of various medical sciences can determine their level of competence for medical tr...
Intangibility of the invisible hand – Analysing the micro-dynamics of novice mentoring program based upon one institutional experience
Although mentoring has been regarded as an essential component in the developmental phase of medical students, it is the nature of hierarchical relationship and the quality of emotional exchange which determine its susta...
Develop talents to increase productivity: report of the ninth national medical science olympiad in Islamic Republic of Iran in year 2017
Extracurricular activities for the gifted and talented students in Iran derive from the belief that students with high potentials are expected to make great help for the health care of the community. One of these activit...
The professionalization of Iranian hospital social workers
Introduction: Identity is formed through our understanding of ourselves and what others perceive of our actions and how we do things. Formation of professional identity includes development, advancement and socialization...