Validity and reliability of research instruments: Principles and actual practice
Journal Title: Pedagogicka Orientace - Year 2013, Vol 23, Issue 4
Abstract
The aim of the paper was to explore how principles of estimating validity and reliability of research instruments, as described in respected methodology textbooks, are satisfied. The initial parts of the paper delineate the theoretical framework and describe the concepts of validity and reliability. The following sections of the paper explain the process of analysis and its βindings. The Journal of Educational Research was chosen as the research focus. A sample of 56 randomly selected articles from it has been inspected. The analysis revealed that a large majority (91 %) of research instruments used in these articles was scales and tests, the rest were questionnaires, observation schemes and interviews. Surprisingly, validity was calculated only with 26 of instruments; the rest of instruments were standardized tests or they were face-validated. As far as scales are concerned, construct validity was documented by means of factor analyses. Content validity and face validity were used in tests, questionnaires and interviews. We consider the infrequent use of combination of two sources of validity (e.g., construct and concurrent or discriminant) to be a weak element in the validation processes in the sample of studies. Reliability was documented with 80 % of research instruments. The most frequent method of calculation was Cronbach’s alpha. Inter-rater reliability was used in observations and tests; test-retest reliability was used to control the stability of the pretest-posttest measuring instrument. The size of reliability coefβicients in most of studies exceeded 0.80. Throughout the analysis it was corroborated that when judging validity and reliability one has to critically consider the specific conditions of each research study before expressing an evaluation statement.
Authors and Affiliations
Peter Gavora
Keywords
Related Articles
- EP ID EP120710
- DOI 10.5817/PedOr2013-4-511
- Views 126
- Downloads 0
Foreign language didactics: Identity questions
The efforts to emancipate foreign language didactics have been an ongoing and non-linear process launched in our country in the 50s of the previous century. Its key aspects may be presented as foreign language didactic...
Stav a výhledy českého pedagogického výzkumu
Cílem přehledové studie je hodnotit stav českého pedagogického výzkumu a naznačit možné perspektivy jeho vývoje. Studie je rozvržena do tří částí. V první části je čtenář uveden do širšího kontextu problému, jímž je re...
Sdílení znalostí ve školním prostředí
Sdílení znalostí je kategorií, s níž operují různé obory, např. informatika, sociologie, psychologie, management. V pedagogice jde o relativně nový fenomén, který má své místo ve výzkumu a pedagogické teorii i v pedagogi...
Výchovná kompetence v dalším vzdělávání pracovníků s dětmi a mládeží
Příspěvek se zabývá výchovnou kompetencí dobrovolného pracovníka s dětmi a mládeží v oblasti volného času. Stručně popisuje problematiku volného času, současné výchovy ve volném čase a dalšího vzdělávání těchto pracovník...
Reading Strategies of Primary School Pupils in the Czech Republic
This article focuses on reading with comprehension – an activity of the reader which is seen as an interaction between the author and the recipient. In order to understand a text better, a reader may employ various tec...