Work

Thapar Titan/s : Fine-Tuning Pretrained Language Models with Contextual Augmentation for Mistake Identification in Tutor–Student Dialogues

Year: 2025

Type: conference-paper

Abstract: This paper presents Thapar Titan/s' submission to the BEA 2025 Shared Task on Pedagogical Ability Assessment of AI-powered Tutors (Kochmar et al., 2025).The shared task consists of five subtasks; our team ranked 18th in Mistake Identification, 15th in Mistake Location, and 18th in Actionability.However, in this paper, we focus exclusively on presenting results for Task 1: Mistake Identification, which evaluates a system's ability to detect student mistakes.Our approach employs contextual data augmentation using a RoBERTa based masked language model to mitigate class imbalance, supplemented by oversampling and weighted loss training.Subsequently, we fine-tune three separate classifiers: RoBERTa, BERT, and DeBERTa for three-way classification aligned with task-specific annotation schemas.This modular and scalable pipeline enables a comprehensive evaluation of tutor feedback quality in educational dialogues.

Source: Workshop on Innovative Use of NLP for Building Educational Applications

DOI: 10.18653/v1/2025.bea-1.103

Authors: Harsh Dadwal, Sparsh Rastogi, Jatin Bedi

Institution: Thapar Institute of Engineering & Technology

Language: English

Topic: Intelligent Tutoring Systems and Adaptive Learning

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

SDG: Quality education

Open Access status: hybrid

OpenAlex ID: W4412889108