Work

Is EVALITA Done? On the Impact of Prompting on the Italian NLP Evaluation Campaign

Year: 2022
Type: conference-paper
Abstract: Prompt-based learning is a recent paradigm in NLP that leverages large pre-trained language models to perform a variety of tasks. With this technique, it is possible to build classifiers that do not need training data (zero-shot). In this paper, we assess the status of prompt-based learning applied to several text classification tasks in the Italian language. The results indicate that the performance gap towards current supervised methods is still relevant. However, the difference in performance between pre-trained models and the characteristic of the prompt-based classifier of operating in a zero-shot fashion open a discussion regarding the next generation of evaluation campaigns for NLP.
Institution: University of Turin
Language: English
Open Access status: green
OpenAlex ID: W7217546014
FWCI:
Cites:
Cited by:
Related to: 10