Validity and reliability of research instruments: Principles and actual practice
Journal Title: Pedagogicka Orientace - Year 2013, Vol 23, Issue 4
Abstract
The aim of the paper was to explore how principles of estimating validity and reliability of research instruments, as described in respected methodology textbooks, are satisfied. The initial parts of the paper delineate the theoretical framework and describe the concepts of validity and reliability. The following sections of the paper explain the process of analysis and its βindings. The Journal of Educational Research was chosen as the research focus. A sample of 56 randomly selected articles from it has been inspected. The analysis revealed that a large majority (91 %) of research instruments used in these articles was scales and tests, the rest were questionnaires, observation schemes and interviews. Surprisingly, validity was calculated only with 26 of instruments; the rest of instruments were standardized tests or they were face-validated. As far as scales are concerned, construct validity was documented by means of factor analyses. Content validity and face validity were used in tests, questionnaires and interviews. We consider the infrequent use of combination of two sources of validity (e.g., construct and concurrent or discriminant) to be a weak element in the validation processes in the sample of studies. Reliability was documented with 80 % of research instruments. The most frequent method of calculation was Cronbach’s alpha. Inter-rater reliability was used in observations and tests; test-retest reliability was used to control the stability of the pretest-posttest measuring instrument. The size of reliability coefβicients in most of studies exceeded 0.80. Throughout the analysis it was corroborated that when judging validity and reliability one has to critically consider the specific conditions of each research study before expressing an evaluation statement.
Authors and Affiliations
Peter Gavora
Keywords
Related Articles
- EP ID EP120710
- DOI 10.5817/PedOr2013-4-511
- Views 141
- Downloads 0
Přehledové studie: jejich typologie, funkce a způsob vytváření
Studie seznamuje čtenáře s tím, jak napsat kvalitní přehledovou studii, která by shrnula soudobé poznatky o zvoleném výzkumném tématu. Cílem studie je předložit typologii přehledových studií; charakterizovat různé funkce...
Teachers’ professional vision: exploring and clarifying the concept
This theoretical study introduces the concept of professional vision into Czech academic discourse as one of the potential concepts that can be used when contemplating (teacher) professionalization. At the beginning th...
Komparácia profesijných činností slovenských, českých a poľských učiteľov na primárnom stupni školy
Cieľom príspevku je porovnať profesijné činnosti učiteľov troch krajín z hľadiska ich časovej záťaže. V úvode autorka venuje pozornosť pojmu profesiografia učiteľa a zameriava sa na súčasné profesiografické výskumy, kt...
The role of Rituals in Education
The study reports on relations between the field of so-called ritual studies and the educational sphere. The author points out the relations between rituals and the process of human shaping and learning, the state of rit...
Didactic background of children’s reading and perspectives of neuroscience
The goal of this review is to look up research studies, that have by using the functional or electrophysiological methods investigated the activation of cortical parts of brain during reading or narrating a story (narrat...