arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.08677cs.CL
收藏

复杂话语的自然语言分解与解释

Natural Language Decomposition and Interpretation of Complex Utterances

Microsoft Semantic Machines(微软语义机器)

Harsh Jhamtani, Hao Fang, Patrick Xia, Eran Levy, Jacob Andreas, Ben Van Durme

AI总结:

提出基于分层自然语言分解与解释的方法,利用预训练语言模型将复杂话语拆分为简单步骤并逐步解释,在几乎无需复杂训练数据的情况下有效解析复杂意图,并发布了新基准DeCU。

摘要:

设计自然语言接口历来需要收集监督数据,以将用户请求转化为精心设计的意图表示。这需要枚举并标注长尾的用户请求,极具挑战性。同时,大型语言模型(LLMs)编码了关于目标和计划的知识,可帮助会话助手解释需要众多步骤才能完成的用户请求。我们引入了一种方法,通过分层自然语言分解和解释的过程,处理来自用户的包含复杂意图的话语。该方法利用预训练语言模型将复杂话语分解为一系列更简单的自然语言步骤,并使用专为该接口设计的language-to-program模型解释每个步骤。为测试该方法,我们收集并发布了DeCU——一个用于评估复杂话语分解(Decomposition of Complex Utterances)的新NL-to-program基准。实验表明,所提方法在几乎没有复杂训练数据的情况下即可解释复杂话语,同时优于标准的少样本提示方法。

英文摘要:

Designing natural language interfaces has historically required collecting supervised data to translate user requests into carefully designed intent representations. This requires enumerating and labeling a long tail of user requests, which is challenging. At the same time, large language models (LLMs) encode knowledge about goals and plans that can help conversational assistants interpret user requests requiring numerous steps to complete. We introduce an approach to handle complex-intent-bearing utterances from a user via a process of hierarchical natural language decomposition and interpretation. Our approach uses a pre-trained language model to decompose a complex utterance into a sequence of simpler natural language steps and interprets each step using the language-to-program model designed for the interface. To test our approach, we collect and release DeCU -- a new NL-to-program benchmark to evaluate Decomposition of Complex Utterances. Experiments show that the proposed approach enables the interpretation of complex utterances with almost no complex training data, while outperforming standard few-shot prompting approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑