The Influence of Item Formats when Locating a Student on a Learning Progression in Science
Journal Title: International Journal of Assessment Tools in Education - Year 2016, Vol 3, Issue 2
Abstract
Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning progression for carbon cycling. The item formats investigated were Constructed Response (CR) items and two types of two-tier items: (1) Ordered Multiple-Choice (OMC) followed by CR items and (2) Multiple True or False (MTF) followed by CR items. Our results suggest that estimates of students’ learning progression level based on OMC and MTF responses are moderately predictive of their level based on CR responses. With few exceptions, CR items were effective for differentiating students among learning progression levels. Based on the results, we discuss how to design and best use items in each format to more accurately measure students’ level along learning progressions in science.
Authors and Affiliations
Jing Chen, Amelia Wenk Gotwals, Charles W. Anderson, Mark D. Reckase
Keywords
Related Articles
- EP ID EP174032
- DOI 10.21449/ijate.245196
- Views 135
- Downloads 0
The development of a self-efficacy scale for mathematical modeling competencies
Mathematical modeling has come into prominence during the last few decades in many countries’ mathematics teaching curricula. It combines real life situations with mathematical context. Although evaluating students’ math...
Are We Measuring Teachers’ Attitudes towards Computers in Detail?: Adaptation of a Questionnaire into Turkish Culture
Teachers’ perceptions of computers play an important role in integrating computers into education. The related literature includes studies developing or adapting a survey instrument in Turkish culture measuring teachers’...
Look Sir, I Drew You
The purpose of this study is to try to find out how the fifth, sixth, seventh and eighth graders perceive science teachers through the pictures they have drawn. A qualitative research method was used in the research. A t...
The Colorado Learning Attitudes about Science Survey (CLASS): The Study of Validity and Reliability
The aim of this research is to adapt the Colorado Learning Attitudes about Science Survey (Adams et al., 2006) to Turkish and to examine its psychometric properties. The research was conducted on 400 9th grade students f...
Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches
This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA) and Rasch modeling, the authors investigate th...