Work

LTRC-IIIT at MEDIQA-SYNUR 2026: Benchmarking a Fully Local, Training-Free RAG Pipeline

Year: 2026
Type: conference-paper
Abstract: In this paper we present our solution to MEDIQA-SYNUR 2026 shared task organized at LREC-ClinicalNLP workshop.The goal of the task is to populate Electronic Health Record (EHR) flowsheets using the transcriptions of nurse dictations, to alleviate the extensive manual labor associated with sifting through large flowsheets of clinical concepts.We propose a modular architecture combining heuristic-driven Retrieval-Augmented Generation (RAG) with grammar-constrained decoding on an open-weight, quantized, 8B-parameter model (Llama 3.1 Instruct).Our system achieves an F1 score of 0.57, significantly trailing the initial zero-shot experiments with GPT-4o (F1 ≈ 0.88) and placing it towards the lower end of the current leaderboard.We conduct a failure analysis of this approach while establishing a baseline for privacy-preserving, zero-shot documentation assistants.
Language: English
Open Access status: hybrid
OpenAlex ID: W7166586091
FWCI:
Cites:
Cited by:
Related to: 10