The Influence of Item Formats when Locating a Student on a Learning Progression in Science

Journal Title: International Journal of Assessment Tools in Education - Year 2016, Vol 3, Issue 2

Abstract

Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning progression for carbon cycling. The item formats investigated were Constructed Response (CR) items and two types of two-tier items: (1) Ordered Multiple-Choice (OMC) followed by CR items and (2) Multiple True or False (MTF) followed by CR items. Our results suggest that estimates of students’ learning progression level based on OMC and MTF responses are moderately predictive of their level based on CR responses. With few exceptions, CR items were effective for differentiating students among learning progression levels. Based on the results, we discuss how to design and best use items in each format to more accurately measure students’ level along learning progressions in science.

Authors and Affiliations

Jing Chen, Amelia Wenk Gotwals, Charles W. Anderson, Mark D. Reckase

Keywords

Related Articles

Parental Perceptions about Children’s Authentic Assessment and the Work Sampling System’s implementation

The authentic assessment process in preschool education gains the confidence of the practices which are used today, as an innovative educational policy in the interest of everyone who’s involved in early childhood educat...

Middle School Mathematics Teachers' Opinions on Feedback

During instruction, providing feedbacks improves students’ academic achievements as well as motivates them to actively engage in lesson activities. Feedback is very important for teaching. Feedback is not only a function...

Are We Measuring Teachers’ Attitudes towards Computers in Detail?: Adaptation of a Questionnaire into Turkish Culture

Teachers’ perceptions of computers play an important role in integrating computers into education. The related literature includes studies developing or adapting a survey instrument in Turkish culture measuring teachers’...

A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions

This study investigated the effectiveness of logistic regression models to detect uniform and non-uniform DIF in polytomous items across small sample sizes and non-normality of ability distributions. A simulation study w...

The Effect of School Efficiency on Student Achievement

This study was conducted to determine the effect of school efficiency of secondary schools on student achievement based on the views of teachers. A scale was prepared in line with the aims of the study, and this scale wa...

Download PDF file
  • EP ID EP174032
  • DOI 10.21449/ijate.245196
  • Views 133
  • Downloads 0

How To Cite

Jing Chen, Amelia Wenk Gotwals, Charles W. Anderson, Mark D. Reckase (2016). The Influence of Item Formats when Locating a Student on a Learning Progression in Science. International Journal of Assessment Tools in Education, 3(2), 101-122. https://europub.co.uk/articles/-A-174032