Increasing the Generalizability of Similarity-Based Essay Scoring Through Cross-Prompt Training
Year: 2025
Type: conference-paper
Abstract: In this paper, we address generic essay scoring, i.e., the use of training data from one writing task to score data from a different task.We approach this by generalizing a similarity-based essay scoring method (Xie et al., 2022) to learning from texts that are written in response to a mixture of different prompts.In our experiments, we compare within-prompt and crossprompt performance on two large datasets (ASAP and PERSUADE).We combine different amounts of prompts in the training data and show that our generalized method substantially improves cross-prompt performance, especially when an increasing number of prompts is used to form the training data.In the most extreme case, this leads to more than double the performance, increasing QWK from .26 to .55.
Authors: Marie Bexte, Yuning Ding, Andrea Horbach
Institution: FernUniversität in Hagen
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: hybrid
OpenAlex ID: W4412889227