MEMORA: A Memory-Enhanced Multimodal Committee Reranking Agent for Reasoning-Intensive Retrieval
Year: 2026
Type: conference-paper
Abstract: Reasoning-intensive retrieval is fundamentally challenged when queries demand deep semantic inference and arrive in multimodal form.Existing systems treat each query in isolation, rely on monolithic rerankers, and lack retrievers trained for cross-modal reasoning.We introduce MEMORA 1 , a Memory-Enhanced Multimodal Orchestrated Reranking Agent built around three contributions: (1) Collaborative Factor-Committee Reranking, which decomposes queries into intent factors, extracts factor-specific evidence into a structured matrix, and synthesizes judgments via a memory-conditioned meta-verdict model;(2) an Episodic Memory Module that tracks factor outcomes across queries and dynamically adjusts priorities at inference time; and(3) a Reasoning-Aware Dense Retriever finetuned with chain-of-thought augmentation on 20k+ reasoning-intensive pairs.Evaluated on MM-BRIGHT across 29 domains, MEMORA achieves nDCG@10 of 41.5 (text-to-text) and 38.9 (multimodal query-to-text), outperforming the strongest agentic text-only baseline by +8.3 points and the strongest agentic multimodal baseline by +7.9 points.
Institutions: Chungbuk National University, Universität Innsbruck
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
OpenAlex ID: W7222997288
