Enhancing Large Language Models for document-level relation triple extraction via structural awareness and contrastive learning
Year: 2026
Type: article
Abstract: In recent years, Large Language Models (LLMs) have demonstrated superior performance in information extraction tasks. Leveraging these models for Document-Level Relation Extraction (DocRE) can benefit from their powerful generative capabilities. However, we observe that LLMs still face challenges in DocRE tasks: Document Structure Parsing Error, Relation Definition Ambiguity, and Entity Boundary Recognition Error. To address these issues, we propose SDB-DRE, an LLM-based DocRE model that does not rely on pre-labeled entities during inference. To tackle the Document Structure Parsing Error, we introduce a novel Structure-Aware QA training approach, enabling LLMs to learn coreference relationships and entity types within the document. To address relation definition ambiguity and entity boundary recognition errors, we introduce relation definition learning and mention boundary learning in the second stage of relation extraction training. These components improve the internal document representation of the LLM, ensuring the output triples are consistent with the relation definitions and have more accurate entity boundaries. Experimental results demonstrate that SDB-DRE surpasses LLM-based methods employing multi-stage reasoning in terms of performance under a single-stage reasoning setup, while also achieving higher inference efficiency. The code will be made publicly available upon acceptance.
Institution: Dalian University of Technology
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $3,670
Awards: G442173326, G5150479751, G7236423398
OpenAlex ID: W7214532415