Work

Memory-Augmented Architecture for Long-Term Context Handling in Large Language Models

Year: 2026
Type: article
Abstract: Large Language Models struggle to maintain coherent, contextually-aware interactions over long dialogues due to the inherent limitations of fixed-length context windows. This leads to fragmented conversations, loss of essential information, and diminished user experience. We address this challenge by introducing a memory-augmented architecture with a dynamic, relevance-based pruning mechanism that evaluates and manages stored information based on its semantic importance to the ongoing conversation, rather than relying on simplistic temporal heuristics. Our approach enables intelligent retrieval, updating, and pruning of memory, ensuring that contextually vital information is retained. Extensive experiments across eight benchmarks demonstrate that our method improves long-term contextual coherence, achieves a 7.6% relative accuracy gain, and reduces memory overhead by 24.6% compared to state-of-the-art baselines.
Language: English
Open Access status: green
OpenAlex ID: W7164000559
FWCI: 2.904
Cites: 26
Cited by: 4
Related to: 10