The handling of missing binary data in language research
Journal Title: Studies in Second Language Learning and Teaching - Year 2015, Vol 5, Issue 1
Abstract
Researchers are frequently confronted with unanswered questions or items on their questionnaires and tests, due to factors such as item difficulty, lack of testing time, or participant distraction. This paper first presents results from a poll confirming previous claims (Rietveld & van Hout, 2006; Schafer & Graham, 2002) that data replacement and deletion methods are common in research. Language researchers declared that when faced with missing answers of the yes/no type (that translate into zero or one in data tables), the three most common solutions they adopt are to exclude the participant’s data from the analyses, to leave the square empty, or to fill in with zero, as for an incorrect answer. This study then examines the impact on Cronbach’s α of five types of data insertion, using simulated and actual data with various numbers of participants and missing percentages. Our analyses indicate that the three most common methods we identified among language researchers are the ones with the greatest impact on Cronbach's α coefficients; in other words, they are the least desirable solutions to the missing data problem. On the basis of our results, we make recommendations for language researchers concerning the best way to deal with missing data. Given that none of the most common simple methods works properly, we suggest that the missing data be replaced either by the item’s mean or by the participants’ overall mean to provide a better, more accurate image of the instrument’s internal consistency.
Authors and Affiliations
François Pichette, Sébastien Béland, Shahab Jolani, Justyna Leśniewska
Keywords
Related Articles
- EP ID EP256518
- DOI 10.14746/ssllt.2015.5.1.8
- Views 145
- Downloads 0
Exploring goals and motivations of Māori heritage language learners
Motivations of Māori heritage language learners are explored within this qualitative study. Te reo Māori (the Māori language) is currently classed as endangered (Reedy et al., 2011), which calls for the exploration of th...
Language aptitude: Desirable trait or acquirable attribute?
The traditional definition of language aptitude sees it as “an individual’s initial state of readiness and capacity for learning a foreign language, and probable facility in doing so given the presence of motivation and...
How I see it: An exploratory study on attributions and emotions in L2 learning
Learners’ attributions have received increasing attention in second/foreign language (L2) learning. Studies have shown that how learners attribute their performance influences not only their self-efficacy, motivation, an...
Proficiency effect on L2 pragmatic competence
This paper synthesizes cross-sectional studies of the effect of proficiency on second language (L2) pragmatics to answer the synthesis question: Does proficiency affect adult learners’ pragmatic competence? Findings have...
Emotional experiences beyond the classroom: Interactions with the social world
Research into the emotional experiences of language learners and their impact upon the language-learning process remains relatively undernourished within second language education. The research available focuses primaril...