Work

GRAD: Generalizing RAG Adaptation with Decoding

Year: 2026
Type: conference-paper
Abstract: Retrieval-augmented generation needs generation to follow retrieved evidence across shifting domains and prompt layouts, but training a new stronger model per task is costly.To this end, we propose GRAD, an adaptive decodingtime framework that keeps the base generator fixed and composes small, objective-specific guidance at inference.A key advantage of this design is enabling mix and match diverse RAG objectives: model scaling (MS), domain adaptation (DA) and positional debiasing (DB) can be integrated as token-level guidance terms, and new objectives can be easily plugged in.Across public benchmarks and private settings with no in-domain labels, GRAD improves accuracy with favorable latency, offering strong trade-offs versus scaling while reliably activating helpful objectives and suppressing harmful ones, adaptively to tasks.
Language: English
Open Access status: hybrid
OpenAlex ID: W7166830515
FWCI:
Cites: 22
Cited by:
Related to: 10