CultRAG at SemEval-2026 Task 7: Hybrid Sparse-Dense Retrieval with Entity-Centric Knowledge Bases for Cultural MCQ Answering
Year: 2026
Type: conference-paper
Abstract: We present a trust-weighted Retrieval-Augmented Generation (RAG; Lewis et al., 2020) system for SemEval-2026 Task 7 (BLEnD) Track 2 (Ousidhoum et al., 2026), targeting English cultural multiple-choice QA across 30 countries.Built atop Llama-3.1-8B-Instruct(Meta AI, 2024), the six-phase pipeline integrates hybrid BM25+FAISS retrieval, country-aware filtering, intent detection, tiered routing, anti-leak prompt engineering, and trust-weighted reranking.The core finding is that RAG hurts rather than helps: the LLM-only baseline achieves 78.6% accuracy, outperforming the full system at 78.5% (McNemar's test, p = 0.962).Oracle analysis reveals that only 40.7% of questions are answerable from the knowledge base, explaining why retrieval introduces more noise than signal.The sole recovery comes from anti-leak prompt filtering (Phase 4), which mitigates answer-anchoring artifacts.Code:
Authors: Aditya Singh, Rickarya Das
Institution: Indian Institute of Technology Kharagpur
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7166825378