Year: 2026
Type: article
Abstract: Although advancements in research designs, quality, statistical rigor, and analytic complexity are widely assumed applied linguistics, empirical evidence supporting these claims remains scarce. This paper explores the evolution of quantitative methods in applied linguistics research over a 29-year period (1996–2024). Using a corpus of data from the journal Applied Linguistics, this study examines longitudinal trends in (a) methodological features, (b) research designs and statistical analytic procedures, and (c) rigor/significance reporting practices. Specifically, it explores changes in sampling, number of variables, and questions/hypotheses, data sources, research design types (e.g., experimental, correlational), and analytic procedures (parametric, non-parametric). Further, it evaluates trends in instrument validation (e.g., reliability, factor analysis) and reporting practices (e.g., effect sizes, p-values). Our analyses (in R) combined descriptive, chi-square tests, standardized residuals, and Cochran–Armitage trend tests to distinguish overall distributional differences, monotonic trends, and localized deviations over time. Temporal changes (5-year trends) in categorical variables were assessed using a combination of contingency-based and trend-focused procedures. By analyzing these monotonic/non-monotonic trends (e.g., sieve-bootstrap Mann–Kendall test), the study offers a comprehensive snapshot of how methodological rigor in the field has evolved in response to technological advances, changing publication demands, and stakeholder expectations. Results suggest that many observed trends in our data were not random fluctuations, indicating the presence of significant quadratic upward and downward trends in several variables across different year-groups over the 29-year period. This work addresses a critical gap in understanding the trajectory of quantitative research in the field, offering insights into future scholarly practices.
Authors: Nihat Polat, Elvan Ceyhan, Laura Mahalingappa
Institutions: University of Maryland, College Park, Auburn University
Language: English
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: hybrid
Estimated APC paid: $2,000
OpenAlex ID: W7213971277