Is Cross-Marking A Way To Increase Rater Reliability?
Journal Title: International Journal of Langauges' Education and Teaching - Year 2018, Vol 6, Issue 3
Abstract
Most of the error correction research has focused on whether teachers should correct errors in student writing, how they should do it and how deep it should be. Recent research, thus, has mostly focused on pedagogical merits of error correction and its possible benefits for student learning. However, in some particular contexts where graders make multiple scorings on the same paper, not much has been investigated to see if those corrections manipulate other graders or whether the writing teachers’ corrections on students’ papers have a positive or negative impact on the reliability of the scores when raters see the corrections of the other graders on the papers they mark. This study intended to explore whether corrections made by the graders affect the scores of colleagues who are scoring the same papers second time to gain more accurate results and to ensure the rating reliability. To do that, 12 writing teachers graded 20 student essays written by intermediate level English learners. The participants were first asked to grade 10 papers without doing error correction and those papers were re-scored after 3 weeks by the same graders, inter-rater and intra-rater reliability computations were carried out for this set of papers to see the actual reliability levels of the raters under normal circumstances. In the second stage, the graders were asked to score the other 10 papers, but this time they also made error corrections on the papers and after 3 weeks, the same teachers graded the same papers that were corrected by their pair graders. The scores assigned each time to these papers by the same raters, were compared statistically and the effect of error correction was investigated on their scores. In conclusion, the results revealed that error marking and grader comment on writing papers may have a negative effect on raters’ intra-rater reliability levels whereas it could have a positive effect on raters’ inter-rater reliability levels when a pool of raters grade the same papers.
Authors and Affiliations
Murat POLAT
Keywords
Related Articles
- EP ID EP614018
- DOI 10.18298/ijlet.3138
- Views 98
- Downloads 0
Cumhuriyet Dönemi Rus Edebiyatından Türkçeye Yapılan Edebi Çeviriler
Uygarlık tüm toplumların kültürel zenginlikleriyle bir bütündür. Toplumların; ulusallıktan evrenselliğe, çağdaş uygarlık düzeyine ulaşma süreci ve çeviri arasında güçlü bir bağ bulunmaktadır. Toplumlar siyasal ve ekonom...
Activities Using Task Based Approach to Teach Turkish to Foreigners
Learning a foreign language and using it effectively is getting more and more important each passing day. In the globalizing world, people want to learn a foreign language for different purposes. The number of people who...
Blended Learning: Improving Student’s Motivation in English Teaching Learning Process
This research aims at revealing: the blended learning; the advantages of blended learning in the 21st century; the application of blended learning in the classroom. It is kinds of qualitative research which are aimed at...
EFFECTS OF COOPERATIVE LEARNING METHOD ON THE DEVELOPMENT OF LISTENING COMPREHENSION AND LISTENING SKILLS
In this study, the effect of the learning together technique, which is one of the cooperative learning methods, on the development of the listening comprehension and listening skills of the secondary school eighth grade...
An Analysis on Reading Texts in Teaching Turkish to Foreigners
Being one of the four basic language skills, reading has a great importance in teaching Turkish to foreigners. It is required to develop reading skills to develop vocabulary. There have been some problems in teaching Tur...