A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences
Year: 2025
Type: conference-paper
Abstract: While progress has been made in legal applications, law reasoning, crucial for fair adjudication, remains unexplored.We propose a transparent law reasoning schema enriched with hierarchical factum probandum, evidence, and implicit experience, enabling public scrutiny and preventing bias.Inspired by this schema, we introduce the challenging task, which takes a textual case description and outputs a hierarchical structure justifying the final decision.We also create the first crowd-sourced dataset for this task, enabling comprehensive evaluation.Simultaneously, we propose an agent framework that employs a comprehensive suite of legal analysis tools to address the challenge task.This benchmark paves the way for transparent and accountable AI-assisted law reasoning in the "Intelligent Court" 1 .
Authors: Jiaxin Shen, Jinan Xu, Huiqi Hu, Luyi Lin, Guoyang Ma, Fei Zheng, Fandong Meng, Jie Zhou, Wenjuan Han
Language: English
Field: Social Sciences
Domain: Social Sciences
Open Access status: gold
Award: G3962098433
OpenAlex ID: W4412887966