Work

GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL

Year: 2026
Type: conference-paper
Abstract: While Large Language Models have significantly advanced Text2SQL generation, a critical semantic gap persists: syntactically valid queries can still misinterpret user intent.To mitigate this challenge, we propose GBV-SQL, a multi-agent framework that introduces Guided Generation with SQL2Text Back-translation Validation.In particular, a dedicated validator translates generated SQL back into natural language and checks whether its logic is aligned with the original question.Beyond the method itself, we also conduct a systematic audit of benchmark quality and introduce a typology of "Gold Errors" in Text2SQL datasets.Our analysis shows that benchmark issues can coexist with strong execution accuracy and can substantially affect evaluation outcomes.On the challenging BIRD benchmark, GBV-SQL achieves 63.23% execution accuracy, a 5.8% absolute improvement over the Deepseek-v3-based MAC-SQL setting.Under manually audited benchmark corrections, GBV-SQL reaches 96.5% (dev) and 97.6% (test) on Spider, and 90.42% on repaired BIRD dev, providing a diagnostic view of model behavior under improved gold quality.Our work contributes both a practical framework for semantic validation and an empirical analysis of benchmark integrity in Text2SQL evaluation.
Authors: Daojun Chen, Xi Wang, Shenyuan Ren, Qingzhi Ma, Pengpeng Zhao, An Liu
Language: English
Open Access status: hybrid
OpenAlex ID: W4415316296
FWCI: 6.198
Cites: 35
Cited by: 8
Related to: 10