Confidence intervals, missing data and imputation: a salutary illustration
Journal Title: INTERNATIONAL JOURNAL OF RESEARCH IN EDUCATION METHODOLOGY - Year 2014, Vol 5, Issue 3
Abstract
This paper confirms that confidence intervals are not a generally useful measure or estimate of anything in practice. CIs are recursive in definition and reversed in logic, meaning that they are widely misunderstood. Perhaps most importantly, they should not be used with cases that do not form a complete and true random sample from a known population – the latter is a key premise underlying their calculation. This means that, whatever their merits, CIs should not be used in the vast majority of real-life social science analyses. The second part of the paper illustrates the dangers of ignoring this premise, perhaps on some purported pragmatic grounds. Using 100 simulations of a sample of 100 integers from a uniform population with members in the range 0 to 9, it shows that CIs are very misleading as soon as there is deviation from randomness. For example, when 5% of the cases in each sample are deleted a reported 95% CI would be no better than a 66% CI in reality. If 10% of the lowest score cases are replaced with the achieved mean for the sample, then a reported 95% CI would be more like a 43% CI in reality. In addition, the simulation shows that the mean and standard deviation for any sample are correlated (an issue of linked scale). This illustrates that using the sample standard deviation as an estimate for the SD of the sampling distribution in order to try and assess whether the sample mean is close to the mean of the sampling distribution will simply make matters worse. The best and only available estimate of the sampling distribution mean, in practice, is the sample mean.
Authors and Affiliations
Stephen Gorard
Flat Rate Tuition - Observations and Analysis of Student Persistence and Performance
Facing reduction in public funding and increases in pressure to improve student performance and graduation rates, many public colleges and some state systems have implemented flat rate tuition policies. This study looks...
E-Consultancy: Shifting towards Digital Intelligence
This paper represents the application of e-consultancy in the fields heath sector, engineering and education. Here we are representing the analytical study of the impact of e-consultancy in all the above sectors. In educ...
EFFECT OF CONCEPT MAPPING ON ACHIEVEMENT IN MATHEMATICS OF SECONDARY SCHOOL STUDENTS IN RELATION TO THEIR INTELLIGENCE
Mathematics has been recognized as one of the central strings of human intellectual activity throughout the centuries. From the very beginning, Mathematics has been a living and growing intellectual pursuit. It has its r...
NEW OSAZONE DIAGRAM FOR DETERMINATION OF TWO ALDOSES AND A KETOSE THAT FORM IDENTICAL OSAZONE
A new and interesting osazone diagram was presented for determination and identification of a pair aldoses and a ketose that makes the same osazone. This chart facilitated the finding any aldose and/or ketose yielded the...
POLITICS AND LEADERSHIP FATIGUE IN AFRICA. A THEORETICAL APPRAISAL.
Colonialism cannot be forgotten in Africa because of the disorientation and dissonance it enforced. This scenario paved way for unbridled expropriation of human and material resources. But, by the beginning o...