Analyzing randomized controlled interventions: Three notes for applied linguists
Journal Title: Studies in Second Language Learning and Teaching - Year 2015, Vol 5, Issue 1
Abstract
I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and (c) using traditional significance tests to analyze interventions in which whole groups were assigned to the conditions (cluster randomization). The first practice is labeled superfluous, and taking full advantage of important covariates regardless of balance is recommended. The second is needlessly complicated, and analysis of covariance is recommended as a more powerful alternative. The third produces dramatic inferential errors, which are largely, though not entirely, avoided when mixed-effects modeling is used. This discussion is geared towards applied linguists who need to design, analyze, or assess intervention studies or other randomized controlled trials. Statistical formalism is kept to a minimum throughout.
Authors and Affiliations
Jan Vanhove
Keywords
Related Articles
- EP ID EP256517
- DOI 10.14746/ssllt.2015.5.1.7
- Views 138
- Downloads 0
The impact of contemplative practices on foreign language anxiety and learning
This study looked at the impact of the integration of contemplative practices on foreign language anxiety, positive and negative affect, self-efficacy, classroom climate, and language learning in students enrolled in an...
The role of extensive recasts in error detection and correction by adult ESL students
Most of the laboratory studies on recasts have examined the role of intensive recasts provided repeatedly on the same target structure. This is different from the original definition of recasts as the reformulation of le...
Unconscious motivation. Part II: Implicit attitudes and L2 achievement
This paper investigates the attitudinal/motivational predictors of second language (L2) academic achievement. Young adult learners of English as a foreign language (N = 311) completed several self-report measures and the...
Motivation and emotion in the EFL learning experience of Romanian adolescent students: Two contrasting cases
The aim of this study was to investigate the language learning motivation of two EFL teenage students in Romania and the link between motivation and the emotional dimensions of these adolescents’ learning experiences. Wh...
Digitally-supported language exchanges in primary school: The AlpConnectar project
This article presents the design, implementation and outcomes of AlpConnectar, a Swiss project that exploits technologies for digitally-supported language exchange (LE) in primary schools. Launched in 2013, the project i...