Statistical Tools for Measuring the Quality of Education. Part 4. Modern approach
Journal Title: Науковий вісник Національної академії статистики, обліку та аудиту - Year 2016, Vol 0, Issue 1
Abstract
The article presents an overview of the statistical grounds of testology. The purpose of this paper is to explain the in experienced readers, such as teachers of economic disciplines, opportunities of improvement of quality of education with the utilization of objective andimpartial tools of students’ achievement measurement, known as tests.The first part of the article overviews the shortcomings of the traditional system of evaluation of educational achievements that is built around the use of ordinal scales. The limitations imposed to the possibilities of statistical processing of the raw data by the type of scale are shown. Basic tasks, the corresponding mathematical models, statistical characteristics and sub-test score evaluation reliability formulas are described.The second part of the article describes approaches to the determination of reliability, uniformity and resolution ofthe test, built on the analysis of the correlation between students’answers to the identical questions asked. Options of conversion of primary points to a quantitative scale are provided. Ways of lowering the probability of correctly guessed an swersare shown. The approach to processing of results of complex test structures is given and the possibility of utilization of two-factor analysis of variance (2 WayANOVA) for dichotomoustests reliability estimation is demonstrated.The third and the fourth parts of the article are devoted to the modern theory of tests(IRT).The third part provides an analysis of shortcomings of the CTT, which were the mainfocus of efforts to overcome of IRT supporters during the last 60 years. The theoretical basis for building a Rach model and its subsequent developments is described. The methodology of estimation of properties of the test by its characteristic curves and parameters of its information function is illustrated. The basic equation, the correspondent solution of which gives an estimate of the probability of obtaining a certain personal score of a test is formulated.The fourth part of the article provides various methods of finding a solution of the basicequation for the 1PL and 2PL - models and data preparation for a correct use. Several software packages, both considered to be classical tools as well as brand new ones, are overviewed. An example of ranking of NASO A students’ achievements obtained by traditionalevaluation and IRTapproach is given.
Authors and Affiliations
М. Е. Sinytskyi
Keywords
Related Articles
- EP ID EP563830
- DOI -
- Views 170
- Downloads 0
Ways to Improve Regulation of Audit Activities in the Context of Global Change
Regulation of audit in Ukraine has long been a subject to debate between various stakeholder groups, which is caused by reforms of auditing procedures in Ukraine. The article’s objective is to assess the sufficiency of t...
Інтегрована звітність підприємства: економічна сутність поняття
Зроблено огляд і систематизацію визначень економічної сутності поняття “інтегрована звітність”, наданих різними авторами за період з 2011 по 2016 рік. Проаналізовано динаміку публікаційної активності учених-економістів з...
Evolution of Perceptions about the Essence of Capital as a Scientific Category and a Factor of the Socio-Economic Development
The article’s objective is to investigate the logic of evolution in the essence and forms of capital under the impact of the changing sources and factors of socio-economic development and social wealth. The...
Стратегические решения в контексте аудита предприятий
В статье исследованы и систематизированы стратегические решения предприятий, анализ процесса принятия и реализации которых дает аудитору возможность получить доказательства наличия или отсутствия аудиторского риска продо...
Cyberphysical Systems: The Fundament of Smart Economy
The article deals with the key technological trends underlying cyberphysical systems. The questions of constructing the smart industry as a cyber-physics system are described in their context the, barriers and risks are...