arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.02227cs.CL
收藏

跨域文本到SQL解析的分层SQL到问题生成的数据增强

Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing

Soochow University(苏州大学);Baidu Inc.(百度公司)

Kun Wu, Lijie Wang, Zhenghua Li, Ao Zhang, Xinyan Xiao, Hua Wu, Min Zhang, Haifeng Wang

摘要:

数据增强在深度学习时代因其缓解数据稀疏性的能力而引起了大量的研究关注。对于看不见的评估数据库来说,缺乏标记数据正是跨域文本到SQL解析的主要挑战。以前的工作要么需要人工干预来保证生成数据的质量,要么无法处理复杂的SQL查询。本文提出了一个简单而有效的数据增强框架。首先,给定一个数据库,我们自动产生大量的SQL查询的基础上,一个抽象的语法树语法。为了更好的分布匹配,我们要求训练数据中至少80%的SQL模式被生成的查询覆盖。其次,我们提出了一个分层SQL到问题生成模型,以获得高质量的自然语言的问题,这是这项工作的主要贡献。最后,我们设计了一个简单的采样策略,可以在生成大量数据的情况下大大提高训练效率。在三个跨域数据集上的实验,即,英文的WikiSQL和Spider以及中文的DuSQL表明,我们提出的数据增强框架可以在强基线上持续提高性能,而分层生成组件是改进的关键。

英文摘要:

Data augmentation has attracted a lot of research attention in the deep learning era for its ability in alleviating data sparseness. The lack of labeled data for unseen evaluation databases is exactly the major challenge for cross-domain text-to-SQL parsing. Previous works either require human intervention to guarantee the quality of generated data, or fail to handle complex SQL queries. This paper presents a simple yet effective data augmentation framework. First, given a database, we automatically produce a large number of SQL queries based on an abstract syntax tree grammar. For better distribution matching, we require that at least 80% of SQL patterns in the training data are covered by generated queries. Second, we propose a hierarchical SQL-to-question generation model to obtain high-quality natural language questions, which is the major contribution of this work. Finally, we design a simple sampling strategy that can greatly improve training efficiency given large amounts of generated data. Experiments on three cross-domain datasets, i.e., WikiSQL and Spider in English, and DuSQL in Chinese, show that our proposed data augmentation framework can consistently improve performance over strong baselines, and the hierarchical generation component is the key for the improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑