Year: 2026
Type: conference-paper
Abstract: Multi-hop reasoning over long contexts remains challenging, as it requires integrating relevant contexts scattered across distant sources while resisting semantic drift and noise from distracting content.While retrieval-augmented generation (RAG) has emerged as the prevailing solution, most RAG approaches encode and store context in monolithic memory representations, resulting in noisy retrieval and brittle reasoning.To overcome these limitations, we introduce TAG (Tailoring Memory Granularity), a framework that prestructures memory into diverse granularities and employs a rewardguided navigator to adaptively compose hybrid memory tailored to each query.The navigator is trained with a multi-objective Bradley-Terry loss that learns the relative utility of different memory types, enabling dynamic routing across granularities.This design allows RAG systems to balance fine-grained detail with high-level abstraction, yielding more reliable reasoning.Extensive experiments on longcontext multi-hop question answering (QA) benchmarks show that TAG achieves state-ofthe-art performance.With only 0.033% additional parameters, it remains lightweight, highlighting its practicality as a scalable and effective solution for enhancing language model agents in complex, real-world scenarios.
Institution: Dartmouth College
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7140120271