arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.10418cs.CL
收藏

通过学习不应该生成什么来学习生成问题

Learning to Generate Questions by Learning What not to Generate

University of Alberta(阿尔伯塔大学);Platform and Content Group, Tencent(腾讯平台与内容事业群)

Bang Liu, Mingjun Zhao, Di Niu, Kunfeng Lai, Yancheng He, Haojie Wei, Yu Xu

摘要:

自动问题生成是一种重要的技术,可以改善问答的训练,帮助聊天机器人开始或继续与人类对话,并为教育目的提供评估材料。现有的神经问题生成模型是不够的,主要是由于它们不能正确地对如何选择问题中的每个单词的过程进行建模,即,无论是重复给定的段落还是从词汇表中生成。在本文中,我们提出了我们的线索引导复制网络问题生成(CGC-QG),这是一个序列到序列的生成模型与复制机制,但采用了各种新的组件和技术,以提高问题生成的性能。在CGC-QG中,我们设计了一个多任务标记策略来识别一个疑问词是应该从输入的段落中复制还是生成,引导模型学习复制和生成之间的准确边界。此外,我们的输入通道编码器作为输入,在各种各样的其他功能,由线索词预测器,这有助于确定是否在输入通道中的每个单词是一个潜在的线索被复制到目标问题的预测。线索词预测器的设计是基于一种新的应用程序的图卷积网络的句法依赖树表示的每一个通道,从而能够预测线索词只根据他们的上下文在通道和他们的相对位置的答案在树。我们联合训练线索预测以及问题生成与多任务学习和一些实用的策略,以降低复杂性。广泛的评估表明,我们的模型显着提高了问题生成的性能,并在很大程度上优于所有以前的最先进的神经问题生成模型。

英文摘要:

Automatic question generation is an important technique that can improve the training of question answering, help chatbots to start or continue a conversation with humans, and provide assessment materials for educational purposes. Existing neural question generation models are not sufficient mainly due to their inability to properly model the process of how each word in the question is selected, i.e., whether repeating the given passage or being generated from a vocabulary. In this paper, we propose our Clue Guided Copy Network for Question Generation (CGC-QG), which is a sequence-to-sequence generative model with copying mechanism, yet employing a variety of novel components and techniques to boost the performance of question generation. In CGC-QG, we design a multi-task labeling strategy to identify whether a question word should be copied from the input passage or be generated instead, guiding the model to learn the accurate boundaries between copying and generation. Furthermore, our input passage encoder takes as input, among a diverse range of other features, the prediction made by a clue word predictor, which helps identify whether each word in the input passage is a potential clue to be copied into the target question. The clue word predictor is designed based on a novel application of Graph Convolutional Networks onto a syntactic dependency tree representation of each passage, thus being able to predict clue words only based on their context in the passage and their relative positions to the answer in the tree. We jointly train the clue prediction as well as question generation with multi-task learning and a number of practical strategies to reduce the complexity. Extensive evaluations show that our model significantly improves the performance of question generation and out-performs all previous state-of-the-art neural question generation models by a substantial margin.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑