Year: 2024
Type: conference-paper
Abstract: Extreme Multi-label Classification (XMC) is the task of labeling documents with one or more labels from a large set of classes. In the context of Legal Artificial Intelligence, XMC is relevant to the automatic categorization of documents as they commonly address several orthogonal categorization schemes. Since retrieving a sufficient number of training document examples per class is challenging, XMC models are expected to be particularly effective in zero-shot learning scenarios. Existing approaches rely on transformer-based classification models, which leverage the attention mechanism to attend to specific textual units. However, classical attention scores are not able to differentiate between domain-specific and generic textual units. In this paper, we propose to use a legal entity-aware approach to zero-shot XMC of European Union law documents. By integrating information about domain-specific legal entities we ease the detection of label-sensitive information and prevent XMC models from attending to irrelevant or wrong text spans. The results achieved on the law documents available in the EURLex benchmark show that our approach is superior to both previous transformer-based approaches and opensource Large Language Models.
Source: PORTO@Iris
Authors: Benedetto I., Cagliero L., Tarasconi F.
Institution: Politecnico di Torino
Language: English
Subfield: Law
Field: Social Sciences
Domain: Social Sciences
Open Access status: green
Funder: European Commission
Awards: G4508289328, G482427013
OpenAlex ID: W7216857947
