Work

RAG-Based Legal Document Question Answering using Large Language Models.

Year: 2026
Type: article
Abstract: The recent rapid development of LLMs (Large Language Models) has brought new opportunities to the intelligent analysis and question answering about legal documents. At the same time, the use of conventional LLMs could result in inaccurate answers because of the lack of knowledge completeness, freshness, and relevance to official sources. The issue of inadequate answers provided by LLMs can be solved with the help of RAG (Retrieval-Augmented Generation), which is capable of retrieving relevant documents from an external collection and passing this data as context information to the LLM during the answer generation process. This paper proposes the RAG framework for question answering about legal documents, including legal documents preprocessing, structure-aware text chunking, semantic retrieval, and answer generation with the use of LLM. The proposed approach is designed for retrieving relevant legal provisions, clauses, and cases passages and generating answers based on this evidence. The paper studies the framework through the lens of the following metrics: retrieval accuracy, answer relevance, factual faithfulness, citation correctness, and hallucination rate. The comparative analysis with conventional vector-based RAG and LLM-based question answering will be performed to test the effectiveness of the proposed framework.
Language: English
Subfield: Law
Open Access status: bronze
OpenAlex ID: W7235974087
FWCI:
Cites: 18
Cited by:
Related to: 10