Work

MEMORA: A Memory-Enhanced Multimodal Committee Reranking Agent for Reasoning-Intensive Retrieval

Year: 2026
Type: conference-paper
Abstract: Reasoning-intensive retrieval is fundamentally challenged when queries demand deep semantic inference and arrive in multimodal form.Existing systems treat each query in isolation, rely on monolithic rerankers, and lack retrievers trained for cross-modal reasoning.We introduce MEMORA 1 , a Memory-Enhanced Multimodal Orchestrated Reranking Agent built around three contributions: (1) Collaborative Factor-Committee Reranking, which decomposes queries into intent factors, extracts factor-specific evidence into a structured matrix, and synthesizes judgments via a memory-conditioned meta-verdict model;(2) an Episodic Memory Module that tracks factor outcomes across queries and dynamically adjusts priorities at inference time; and(3) a Reasoning-Aware Dense Retriever finetuned with chain-of-thought augmentation on 20k+ reasoning-intensive pairs.Evaluated on MM-BRIGHT across 29 domains, MEMORA achieves nDCG@10 of 41.5 (text-to-text) and 38.9 (multimodal query-to-text), outperforming the strongest agentic text-only baseline by +8.3 points and the strongest agentic multimodal baseline by +7.9 points.
Language: English
Open Access status: bronze
OpenAlex ID: W7222997288
FWCI:
Cites: 22
Cited by:
Related to: 10