arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.11054cs.CL
收藏

会话式文本到SQL:最先进的技术和未来的挑战

Conversational Text-to-SQL: An Odyssey into State-of-the-Art and Challenges Ahead

Alexa AI, Amazon(亚马逊Alexa AI)

Sree Hari Krishnan Parthasarathi, Lu Zeng, Dilek Hakkani-Tur

摘要:

会话、多轮、文本到SQL(CoSQL)任务将对话中的自然语言语句映射到SQL查询。最新技术水平(SOTA)系统结合约束解码使用大型的、预训练的和微调的语言模型,例如T5系列。通过在训练过程中使用离散提示的连贯任务上进行多任务处理(MT),我们改进了专门的文本到SQL T5系列模型。基于Oracle对n个最佳假设的分析,我们采用了一个查询计划模型和一个模式链接算法作为重排序器。结合MT和重新排序,我们使用T5 - 3B的结果显示,与CoSQL上的SOTA基线相比,精确匹配的绝对准确性提高了1.0%,执行匹配提高了3.4%。虽然这些收益始终体现在回合水平,上下文相关的回合是相当困难的。我们进行研究,梳理除了错误归因于域和合成泛化,后者仍然是一个挑战,多轮对话,特别是在生成SQL与看不见的解析树。

英文摘要:

Conversational, multi-turn, text-to-SQL (CoSQL) tasks map natural language utterances in a dialogue to SQL queries. State-of-the-art (SOTA) systems use large, pre-trained and finetuned language models, such as the T5-family, in conjunction with constrained decoding. With multi-tasking (MT) over coherent tasks with discrete prompts during training, we improve over specialized text-to-SQL T5-family models. Based on Oracle analyses over n-best hypotheses, we apply a query plan model and a schema linking algorithm as rerankers. Combining MT and reranking, our results using T5-3B show absolute accuracy improvements of 1.0% in exact match and 3.4% in execution match over a SOTA baseline on CoSQL. While these gains consistently manifest at turn level, context dependent turns are considerably harder. We conduct studies to tease apart errors attributable to domain and compositional generalization, with the latter remaining a challenge for multi-turn conversations, especially in generating SQL with unseen parse trees.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑