A comparative analysis of common mistakes in achievement tests prepared by school teachers and corporate trainers
Journal Title: European Journal of Science and Mathematics Education - Year 2016, Vol 4, Issue 4
Abstract
Test development has been an important part of measurement and evaluation in any educational setting, whether its purpose is instruction or training. Both teachers and trainers are expected to have certain level of mastery in developing reliable and valid tests for assessing performance of learners adequately. However, it has often been reported that teachers and trainers are not competent enough to develop such tests. Most teachers have taken at least one university course on educational measurement and evaluation during their undergraduate education. Similarly, a considerable number of corporate trainers attend at least one in?service training seminar on measurement and evaluation as a part of their professional training program. However, teachers and trainers still make serious mistakes in preparing tests for assessing the level of learning and performance properly. This study compares their mistakes based on basic principles of test development. More specifically, the researcher wanted to assess whether the mistakes of teachers and trainers are similar or different. Toward this purpose, a total of 120 instructors (62 teachers and 58 trainers) were selected as participants of the study. A total of 6450 test items in various fields of learning were analysed to make comparisons. Results generally suggest that school teachers and corporate trainers make similar mistakes, although their level of knowledge and skills in measurement and evaluation are different due to prior learning. There is also no difference regarding the subject matter area and the level of education for which the tests were developed. Approximately 60% of items need revisions, half of which appear to have severe mistakes. The most common problems are related to easy test items, route learning, implausible distractors, use of negative questions, hidden cues, illogical order of alternatives, length of sentences for correct answers, disturbing sequence of items, single?mode (text?based) questions, and subjective items. These results, along with some others, have serious implications for programs on teacher education and training of trainers.
Authors and Affiliations
Ali Simsek| Department of Communication Design and Management, Anadolu University, Eskisehir, Turkey For correspondence: asimsek@anadolu.edu.tr
Keywords
Related Articles
- EP ID EP8119
- DOI -
- Views 355
- Downloads 32
The importance of learning strategies and how the project ‘Kolumbus-Kids’ promotes them successfully
In education systems learners are expected to possess an increased degree of autonomy and show initiative in learning processes, inspecting learning materials and understanding contents. An efficient growth of knowledge...
Polya and GeoGebra : A dynamic approach to problem solving
Problem solving has been investigated in mathematics education for more than 60 years ago with the pioneering work of George Polya ( Polya , 1965). The four steps he proposes : understand the problem , devise a plan , ca...
Gender and achievement in English language arts, science and mathematics in secondary schools in Nigeria
The education of girls and women in the areas of Science, Technology, Engineering and Mathematics (STEM) has long been thought of as very crucial for national development. This study investigated whether gender differenc...
Challenges for Emirati university students in comprehending mathematical text and word problems
The United Arab Emirates has been rapidly developing its educational institutions and trying to adopt a western system of higher education. The government has chosen English to be the medium of instruction in universitie...
What happens when a climber falls? Young climbers mathematise a climbing situation
Students in Norway and other countries experience vectors as a difficult topic. Four young skilled climbers, who all did well in mathematics at school, participated in the Vector Study (VS). They participated for free an...