Efficacy of AI-Generated Feedback by SmallTalk2Me for Improving Speaking Skill of Saudi EFL Learners
Year: 2025
Type: article
Study design: Clinical Trial
Abstract: Feedback is essential in language teaching and learning as it helps learners identify errors, reinforce correct usage, and guide their progress. Traditionally it was the job of a teacher, however, with the advent of Artificial Intelligence (AI) this task has become automated. This study evaluated the efficacy of AI-generated feedback provided by the SmallTalk2Me platform for improving speaking skill among Saudi EFL learners. Forty-four Saudi EFL learners participated in this quasi-experimental study. The data were derived from the IELTS speaking pre-test and post-test, while in between, the participants completed six practice activities over a period of three weeks (two activities each week). Two data sets were compiled: IELTS speaking band scores and proficiency (measured by words spoken per minute). The data were analyzed using paired t-tests to evaluate statistical significance. The study hypothesized that learners would achieve a higher mean score in the IELTS speaking post-test after completing language practices on SmallTalk2Me. This hypothesis was statistically supported, as the difference between the pre-test and post-test mean scores was significant (p < 0.05). The learners demonstrated a 12.12% improvement in their IELTS speaking test band scores, while an 11.18% increase was observed in their speaking proficiency between the first and the sixth practice activities. Following the intervention, a 25-item questionnaire was administered to evaluate the participants’ perception of AI-generated feedback, the efficacy of SmallTalk2Me, and the overall learning experience. Students found AI-generated feedback effective, motivating, and engaging. The study highlights the efficacy of AI-generated feedback provided by SmallTalk2Me and recommends the use of such AI platforms in the Saudi EFL scenario.
Source: Forum for Linguistic Studies
Author: Shahzad ul Hassan Farooqi
Institution: Majmaah University
Language: English
Subfield: Language and Linguistics
Field: Arts and Humanities
Domain: Social Sciences
SDG: Quality education
Open Access status: diamond
OpenAlex ID: W4408630813