A generalizability Analysis: The reliability of measurements: “Let’s circuit electric”<p>Bir genellenebilirlik kuramı analizi: Değerlendirmede kullanılan ölçme araçlarının güvenirliği “Haydi Elektriği İletelim”
Journal Title: Journal of Human Sciences - Year 2019, Vol 16, Issue 1
Abstract
The study’s purpose was to compare the results of G&K studies of some measurement instruments, used in the current study and also check their reliability. These are a multiple-choice test, a structured grid, and a performance task applied for measuring students’ performance. It is based on Generalizability Theory (GT). The population was the 6th grade students in Antalya, a city in the Mediterranian area in Turkey. During the 2014-2015 school years, forty students (23 girls and 17 boys) from two 6th grade classes randomly selected from two middle schools. The first author was the instructor and it took a month to teach “Let’s Circuit Electricity” unit in a regular classroom environment. For the study’s purpose, a multiple-choice test, a structured grid, and a performance task, developed by the researchers, were utilized to measure students’ achievement in each. The structured grids and performance tasks were graded by three teachers. According to the findings, KR-20 reliability coefficient of the multiple-choice test was .68; while G coefficient .68 and Phi (Φ) coefficients was .64. The Cronbach’s Alpha coefficients for structured grid and G coefficient were .96 and .91, respectively whereas Phi (Φ) coefficient was as .83. Cronbach’s Alpha coefficient for performance task was found as .89; G coefficient as .89, and Phi (Φ) coefficient as .86. According to the results of decision studies, variation of G and Phi coefficient for all three measurements were in line. We also found that three graders’ results were consistent with each other for the structured grid and performance tasks’ grading results. Extended English summary is in the end of Full Text PDF (TURKISH) file. ÖzetAraştırmanın amacı; Genellenebilirlik Kuramını kullanarak öğrenci performansının ölçülmesi amacıyla kullanılan çoktan seçmeli test, yapılandırılmış grid ve performans görevinin Genellenebilirlik (G) ve Karar (K) çalışmalarının yapılarak, sonuçların karşılaştırılmasıdır. Araştırma evrenimiz 2014-2015 eğitim-öğretim yılında Antalya’da öğrenim görmekte olan ortaokul altıncı sınıf öğrencilerini kapsamaktadır. Araştırma çalışma grubu ise Antalya’da iki farklı okuldan rastgele seçilen birer altıncı sınıf şubesinde öğrenim gören 23’ü kız 17’si erkek toplam 40 öğrenciden oluşmaktadır. Elektriği İletelim ünitesi üç haftada araştırmanın birinci yazarı tarafından normal sınıf ortamında işlenmiş; veri toplama aracı olarak araştırmacılar tarafından geliştirilen çoktan seçmeli test, yapılandırılmış grid ve bir performans görevi çalışma grubundaki öğrencilere uygulanmıştır. Bunların değerlendirilmesinde üç puanlayıcının görüşüne başvurulmuştur. Sonuçlara göre çoktan seçmeli testin, G katsayısı .68, Phi (Φ) katsayısı ise .64 bulunmuştur. Yapılandırılmış gridin G katsayısı .91, Phi (Φ) katsayısı ise .83 bulunmuştur. Performans görevi sonuçlarına bakıldığında, G katsayısı .89, Phi (Φ) katsayısının ise .86 şeklinde olduğu görülmüştür. Karar çalışmaları sonucuna göre, üç araç için de elde edilen G ve Phi katsayılarının değişiminin paralellik göstermektedir. Ek olarak yapılandırılmış grid ve performans görevinin değerlendirme sonuçlarının üç puanlayıcı için paralellik gösterdiği de bulgularımız arasındadır.
Authors and Affiliations
Gülşah Başol, Banu Şevran
Keywords
Related Articles
- EP ID EP643598
- DOI -
- Views 131
- Downloads 0
Establishment of educational module “Climate Change” in the University of Liepaja
Increase of awareness and high knowledge base of society in the field of climate change and environment in general in global and local ranges is vital to prevent future possible increase of climate changes in the world....
Varying reasons of young learners’ problem behaviours according to novice ELT teachers
This research is conducted to examine novice ELT teachers’ perspective on the possible motives behind young learners’ problem behaviours in English classes. The gender of ELT teachers have been also considered in order t...
Understanding the effect of aim in life and lonelıness level on attendance to lesson among Azerbaijanı And Turkmenıstanıan undergraduate students
This descriptive study is aimed to investigate the relationship between Azerbaijani and Turkmenistanian undergraduate students’ attendance to lesson, their aim in life and loneliness level. A total of 145 students -105 m...
Students’ perspectives on online and face-to-face components of a blended course design in Health and Kinesiology at a South Western Public University in the USA
Introduction: The current higher education environment in the United States of America (USA) and worldwide is focused on providing people an opportunity to access a quality education at a competitive price and one that i...
Knowledge and opinions of nursing students on palliative care: A university example
Objectives: This study was conducted to determine the level of knowledge of nursing students about palliative care.Methods: The descriptive study was conducted with 324 graduate students who received training at a state...