The Influence of Item Formats when Locating a Student on a Learning Progression in Science
Journal Title: International Journal of Assessment Tools in Education - Year 2016, Vol 3, Issue 2
Abstract
Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning progression for carbon cycling. The item formats investigated were Constructed Response (CR) items and two types of two-tier items: (1) Ordered Multiple-Choice (OMC) followed by CR items and (2) Multiple True or False (MTF) followed by CR items. Our results suggest that estimates of students’ learning progression level based on OMC and MTF responses are moderately predictive of their level based on CR responses. With few exceptions, CR items were effective for differentiating students among learning progression levels. Based on the results, we discuss how to design and best use items in each format to more accurately measure students’ level along learning progressions in science.
Authors and Affiliations
Jing Chen, Amelia Wenk Gotwals, Charles W. Anderson, Mark D. Reckase
Keywords
Related Articles
- EP ID EP174032
- DOI 10.21449/ijate.245196
- Views 115
- Downloads 0
Exploring Teachers’ Assessment Practices and Skills
The need for increased use of test results to improve educational outcomes is urgent; yet, there is little understanding in the research literature of practitioners’ knowledge and skills in interpreting and using educati...
Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation
This study utilized the Rasch model to assess the quality of a survey instrument designed to measure attitudes of administrators and teachers concerning a differentiated teacher compensation program piloted in Kentucky....
Scaling of Ideal Teachers Characteristics with Pairwise Comparison Judgments According to Pre-service Teachers Opinions
In this study, scaling the characteristics that should be found in an ideal teacher according to the pre-service teachers by using the pairwise comparison method was aimed. Thirteen characteristics that an ideal teacher...
Development of “Willingness to Become School Administrator and Adjustment Scale”
The purpose of this study is to develop a likert-style reliable and valid scale in order to measure teachers’ level of willingness and adjustment to become school administrator. Before developing the scale, the literatur...
Middle School Mathematics Teachers' Opinions on Feedback
During instruction, providing feedbacks improves students’ academic achievements as well as motivates them to actively engage in lesson activities. Feedback is very important for teaching. Feedback is not only a function...