XiYan-SQL:一种新型多生成器框架用于文本到SQL
XiYan-SQL: A Novel Multi-Generator Framework For Text-to-SQL
AI总结:
本文提出XiYan-SQL框架,通过多生成器 ensemble 方法生成高质量SQL查询,并结合schema过滤和选择模型提升性能,实现在BIRD和Spider数据集上均取得SOTA结果。
摘要:
为利用LLM在文本到SQL任务中的优势,我们提出了XiYan-SQL框架,该框架有效生成和利用多个SQL候选方案。它由三个组成部分组成:1) 一个模式过滤模块,用于过滤并获取多个相关模式;2) 多生成器集合方法生成多个高质量且多样的SQL查询;3) 一个具有候选重组织策略的选模模块,以获得最优的SQL查询。具体而言,在多生成器集合中,我们采用多任务微调策略,以增强SQL生成模型在SQL与文本内在对齐方面的能力,并通过在不同SQL格式上微调构建多个具有不同生成风格的生成模型。实验结果和全面分析证明了该框架的有效性和鲁棒性。总体而言,XiYan-SQL在著名的BIRD基准上实现了新的SOTA性能,达到75.63%,超过了所有先前方法。它还在Spider测试集上实现了SOTA性能,准确率为89.65%。
英文摘要:
To leverage the advantages of LLM in addressing challenges in the Text-to-SQL task, we present XiYan-SQL, an innovative framework effectively generating and utilizing multiple SQL candidates. It consists of three components: 1) a Schema Filter module filtering and obtaining multiple relevant schemas; 2) a multi-generator ensemble approach generating multiple highquality and diverse SQL queries; 3) a selection model with a candidate reorganization strategy implemented to obtain the optimal SQL query. Specifically, for the multi-generator ensemble, we employ a multi-task fine-tuning strategy to enhance the capabilities of SQL generation models for the intrinsic alignment between SQL and text, and construct multiple generation models with distinct generation styles by fine-tuning across different SQL formats. The experimental results and comprehensive analysis demonstrate the effectiveness and robustness of our framework. Overall, XiYan-SQL achieves a new SOTA performance of 75.63% on the notable BIRD benchmark, surpassing all previous methods. It also attains SOTA performance on the Spider test set with an accuracy of 89.65%.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。