arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2209.07800cs.CL

完整真相且仅此而已:基于数据流转导与受限解码的忠实可控对话回复生成

The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained Decoding

Microsoft Semantic Machines(微软语义机器公司)

Hao Fang, Anusha Balakrishnan, Harsh Jhamtani, John Bufe, Jean Crawford, Jayant Krishnamurthy, Adam Pauls, Jason Eisner, Jacob Andreas, Dan Klein

AI总结:

本文提出一种混合架构,结合数据流转导规则与受限解码,在神经语言模型生成中约束输出,实现既忠实又可控的对话回复生成,并在流畅性、相关性和真实性上超越现有方法。

摘要:

在现实世界的对话系统中,生成的文本必须真实且信息丰富,同时保持流畅并遵循规定的风格。同时满足这些约束对于语言生成中的两种主要范式——神经语言建模和基于规则的生成——而言是困难的。我们描述了一种用于对话回复生成的混合架构,该架构结合了两种范式的优势。该架构的第一个组件是基于规则的内容选择模型,该模型使用一种名为数据流转导(dataflow transduction)的新形式框架来定义,它使用声明性规则将对话代理的动作及其结果(表示为数据流图)转导为上下文无关文法,这些文法表示上下文可接受回复的空间。第二个组件是一种受限解码过程,它使用这些文法来约束神经语言模型的输出,从而选择流畅的话语。我们的实验表明,该系统在流畅性、相关性和真实性的评估中均优于基于规则的方法和基于学习的方法。

英文摘要:

In a real-world dialogue system, generated text must be truthful and informative while remaining fluent and adhering to a prescribed style. Satisfying these constraints simultaneously is difficult for the two predominant paradigms in language generation: neural language modeling and rule-based generation. We describe a hybrid architecture for dialogue response generation that combines the strengths of both paradigms. The first component of this architecture is a rule-based content selection model defined using a new formal framework called dataflow transduction, which uses declarative rules to transduce a dialogue agent's actions and their results (represented as dataflow graphs) into context-free grammars representing the space of contextually acceptable responses. The second component is a constrained decoding procedure that uses these grammars to constrain the output of a neural language model, which selects fluent utterances. Our experiments show that this system outperforms both rule-based and learned approaches in human evaluations of fluency, relevance, and truthfulness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑