arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.04790cs.AI
收藏

Text-to-SQL中的结构泛化

On the Structural Generalization in Text-to-SQL

Jieyu Li, Lu Chen, Ruisheng Cao, Su Zhu, Hongshen Xu, Zhi Chen, Hanchong Zhang, Kai Yu

摘要:

探索文本到SQL解析器的泛化对于系统自动适应现实世界的数据库是必不可少的。以前的工作提供的调查集中在词汇多样性,包括同义词和扰动的影响,在自然语言的问题和数据库。然而,对于数据库模式DS的结构多样性的研究还很缺乏.具体来说,面对相同的输入问题,当DS达到不同的结构时,目标SQL可能以不同的方式表示。在这项工作中,我们提供了关于文本到SQL任务的结构化概括的深入讨论。我们观察到,目前的数据集太模板化,研究结构泛化。为了收集合格的测试数据,我们提出了一个框架,通过自动和同步(DS,SQL)对改变生成新的文本到SQL数据。在实验中,当在合成样本上评估经过良好训练的文本到SQL模型时,性能显着降低,这表明了当前关于结构泛化的研究的局限性。通过综合分析,我们认为实际原因是(NL,SQL)模式的过拟合。

英文摘要:

Exploring the generalization of a text-to-SQL parser is essential for a system to automatically adapt the real-world databases. Previous works provided investigations focusing on lexical diversity, including the influence of the synonym and perturbations in both natural language questions and databases. However, research on the structure variety of database schema~(DS) is deficient. Specifically, confronted with the same input question, the target SQL is probably represented in different ways when the DS comes to a different structure. In this work, we provide in-deep discussions about the structural generalization of text-to-SQL tasks. We observe that current datasets are too templated to study structural generalization. To collect eligible test data, we propose a framework to generate novel text-to-SQL data via automatic and synchronous (DS, SQL) pair altering. In the experiments, significant performance reduction when evaluating well-trained text-to-SQL models on the synthetic samples demonstrates the limitation of current research regarding structural generalization. According to comprehensive analysis, we suggest the practical reason is the overfitting of (NL, SQL) patterns.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑