arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.18596cs.CL
收藏

LinkAlign:面向真实世界大规模多数据库Text-to-SQL的可扩展模式链接

LinkAlign: Scalable Schema Linking for Real-World Large-Scale Multi-Database Text-to-SQL

China Academy of Information and Communications Technology(中国信息通信技术研究院);Renmin University of China(中国人民大学);University of International Business and Economics(国际经济贸易大学)

Yihan Wang, Peiyu Liu, Xin Yang

AI总结:

LinkAlign通过多轮语义增强检索、无关信息隔离和模式提取增强,解决大规模多数据库场景下的模式链接两大挑战,在Spider 2.0-Lite上以开源LLM达到33.09%的新SOTA。

摘要:

模式链接是将现有Text-to-SQL模型应用于真实世界大规模多数据库环境中的关键瓶颈。通过错误分析,我们识别出模式链接中的两大挑战:(1)数据库检索:从大型模式池中准确选择目标数据库,同时有效过滤不相关的数据库;(2)模式项定位:在复杂且通常冗余的模式中精确识别与SQL生成相关的表和列。基于此,我们提出了LinkAlign,一个专为具有数千字段的大规模数据库设计的新颖框架。LinkAlign包含三个关键步骤:针对挑战1的多轮语义增强检索和无关信息隔离,以及针对挑战2的模式提取增强。每个阶段都支持Agent和Pipeline两种执行模式,通过模块化设计实现效率与性能的平衡。为了进行更真实的评估,我们构建了AmbiDB,一个旨在反映真实世界模式链接模糊性的合成数据集。在广泛使用的Text-to-SQL基准上的实验表明,LinkAlign在所有模式链接指标上持续优于现有基线。值得注意的是,它改进了整体Text-to-SQL流程,并仅使用开源LLM在Spider 2.0-Lite基准上取得了33.09%的新最先进分数,在提交时排名排行榜第一。代码可在https://github.com/Satissss/LinkAlign获取。

英文摘要:

Schema linking is a critical bottleneck in applying existing Text-to-SQL models to real-world, large-scale, multi-database environments. Through error analysis, we identify two major challenges in schema linking: (1) Database Retrieval: accurately selecting the target database from a large schema pool, while effectively filtering out irrelevant ones; and (2) Schema Item Grounding: precisely identifying the relevant tables and columns within complex and often redundant schemas for SQL generation. Based on these, we introduce LinkAlign, a novel framework tailored for large-scale databases with thousands of fields. LinkAlign comprises three key steps: multi-round semantic enhanced retrieval and irrelevant information isolation for Challenge 1, and schema extraction enhancement for Challenge 2. Each stage supports both Agent and Pipeline execution modes, enabling balancing efficiency and performance via modular design. To enable more realistic evaluation, we construct AmbiDB, a synthetic dataset designed to reflect the ambiguity of real-world schema linking. Experiments on widely-used Text-to-SQL benchmarks demonstrate that LinkAlign consistently outperforms existing baselines on all schema linking metrics. Notably, it improves the overall Text-to-SQL pipeline and achieves a new state-of-the-art score of 33.09% on the Spider 2.0-Lite benchmark using only open-source LLMs, ranking first on the leaderboard at the time of submission. The codes are available at https://github.com/Satissss/LinkAlign

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑