Year: 2020
Type: conference-paper
Abstract: Most natural language processing research now recommends large Transformer-based models with fine-tuning for supervised classification tasks; older strategies like bag-ofwords features and linear models have fallen out of favor.Here we investigate whether, in automated essay scoring (AES) research, deep neural models are an appropriate technological choice.We find that fine-tuning BERT produces similar performance to classical models at significant additional cost.We argue that while state-of-the-art strategies do match existing best results, they come with opportunity costs in computational resources.We conclude with a review of promising areas for research on student essays where the unique characteristics of Transformers may provide benefits over classical methods to justify the costs.
Authors: Elijah Mayfield, Alan W Black
Institution: Carnegie Mellon University
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W3037207300
