The extent to which research studies are replicable and their findings are reproducible is a concern for researchers and those who put store by our findings, such as teachers, policy-makers, students, and the wider public. Recent methodological and meta-scientific studies suggest that research in applied linguistics is suffering from several problems that threaten reproducibility and replicability, leading to (a) a small amount of published replication research; (b) a (poor) quality of replication research; and (c) a likely (lack of) reproducibility (Marsden, Morgan-Short, Thompson & Abugaber, 2018). These concerns speak to the very core of science, raising fundamental questions about the validity and reliability of our work and the need for collaborative effort and infrastructure. This talk will illustrate these concerns with data from methodological syntheses documenting how our reporting, transparency, and sampling practices do not facilitate replication (Marsden, Thompson, & Plonsky, 2018; Plonsky et al. 2019). I then outline steps the research community can take to improve the situation, including Registered Reports (Marsden et al. 2018), makings materials and data available via repositories such as iris-database.org (Marsden, Mackey, & Plonsky, 2016), and working collaboratively across multiple sites (Morgan-Short et al. 2018). References Marsden, E., Mackey A., & Plonsky, L. (2016). The IRIS Repository. In A. Mackey & E. Marsden (Eds.), Advancing methodology and practice. Routledge Marsden, E., Morgan-Short, K., Trofimovich, P., & Ellis, N. (2018). Introducing Registered Reports [Editorial]. Language Learning, 68. Marsden, E., Thompson, S., & Plonsky, L. (2019). A methodological synthesis of self-paced reading in L2 research. Applied Psycholinguistics, 39. Morgan-Short, K., Marsden, E. J., Heil, J. et al. (2018). Multisite replication in SLA research. Language Learning, 68. Plonsky, L., Marsden, E. J., Crowther, D., Gass, S., & Spinner, P. (2019). A methodological synthesis and meta-analysis of judgment tasks in L2 research. Second Language Research.
