Confidence intervals, missing data and imputation: a salutary illustration
Journal Title: INTERNATIONAL JOURNAL OF RESEARCH IN EDUCATION METHODOLOGY - Year 2014, Vol 5, Issue 3
Abstract
This paper confirms that confidence intervals are not a generally useful measure or estimate of anything in practice. CIs are recursive in definition and reversed in logic, meaning that they are widely misunderstood. Perhaps most importantly, they should not be used with cases that do not form a complete and true random sample from a known population – the latter is a key premise underlying their calculation. This means that, whatever their merits, CIs should not be used in the vast majority of real-life social science analyses. The second part of the paper illustrates the dangers of ignoring this premise, perhaps on some purported pragmatic grounds. Using 100 simulations of a sample of 100 integers from a uniform population with members in the range 0 to 9, it shows that CIs are very misleading as soon as there is deviation from randomness. For example, when 5% of the cases in each sample are deleted a reported 95% CI would be no better than a 66% CI in reality. If 10% of the lowest score cases are replaced with the achieved mean for the sample, then a reported 95% CI would be more like a 43% CI in reality. In addition, the simulation shows that the mean and standard deviation for any sample are correlated (an issue of linked scale). This illustrates that using the sample standard deviation as an estimate for the SD of the sampling distribution in order to try and assess whether the sample mean is close to the mean of the sampling distribution will simply make matters worse. The best and only available estimate of the sampling distribution mean, in practice, is the sample mean.
Authors and Affiliations
Stephen Gorard
Keywords
Related Articles
- EP ID EP654680
- DOI 10.24297/ijrem.v5i3.3894
- Views 124
- Downloads 0
EDUCATIONAL REFORMS IN SCHOOL EDUCATION AND THEIR IMPLICATIONS ON TEACHER EDUCATION
Today, when it is globally acknowledged that lower education should be a right and higher education a privilege, at present we in India seem to be the grip of an overriding ideology which is governing our economy, societ...
Influence of Spirituality on Teaching
Etymologically, the term spirituality is derived from the word Spirit which comes from the Latin spiritus, meaning breath. This suggests something elusive and yet vital. Spirituality is the wholeness of being connec...
DEVELOPING PROGRAMME OF ACTION ON PEACE EDUCATION
People all over the world crave for peace. The educationists, politicians and the leaders of the world are trying their best to achieve world peace, but they face many problems. Many advanced countries of the world try t...
OCCUPATIONAL STRESS AMONG TEACHER EDUCATORS IN RELATION TO ORGANIZATIONAL CLIMATE
In the present age of science and technology, teachers are under stress due to increasing complexities of work and its divergent demands. Organizational climate is the important factor in contributing best work from teac...
The Agent Based Modeling to represent the OER
Within this paper we focus on the representation of open educational resources based on the agent-based modeling. The open educational resources (OER) concept is introduced as well as the agent-based modeling approach (A...