arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.03088cs.CLcs.AI
收藏

面向答案未知的对话式问题生成的“问什么”与“怎么问”建模

Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation

Institute for Infocomm Research (I2R), A*STAR(新加坡科技研究局资讯通信研究院(I2R));Nanyang Technological University, Singapore(新加坡南洋理工大学);Salesforce AI(赛富时人工智能研究院);ByteDance(字节跳动);University of California, Santa Barbara(加州大学圣巴巴拉分校)

Xuan Long Do, Bowei Zou, Shafiq Joty, Anh Tai Tran, Liangming Pan, Nancy F. Chen, Ai Ti Aw

AI总结:

针对答案未知型对话式问题生成中“问什么”与“怎么问”的挑战,提出两阶段框架SG-CQG,结合语义图选推理依据、显式控制问题类型,并提出多样性评估指标Conv-Distinct,实现当前最优性能。

摘要:

对话式问题生成(Conversational Question Generation, CQG)是机器通过对话协助人类满足信息需求的关键任务。该任务通常分为两种设置:答案感知型与答案未知型。前者通过提供预期答案为模型提供便利,而后者更具现实意义,近年来受到越来越多的关注。在答案未知设置下,“问什么”和“怎么问”是两大核心挑战。\n为解决第一个挑战,现有方法主要选取上下文中的连续句子作为推理依据(rationale)。我们认为,采用这种简单启发式规则生成的对话可能不够自然,因为在现实场景中,对话参与者谈论的相关内容在上下文中未必是连续的。此外,以往方法隐式决定待生成问题的类型(是非型/跨度型)。由于无法获取能提示模型生成是非型还是跨度型问题的答案,显式建模问题类型至关重要。\n为此,我们提出SG-CQG——一个两阶段的CQG框架。在“问什么”阶段,我们从构建的语义图中选取一个句子作为推理依据,并从中提取答案跨度。在“怎么问”阶段,分类器通过两个显式控制信号确定问题的目标答案类型,随后进行生成与过滤。此外,我们提出了一种新型CQG评估指标Conv-Distinct,用于评估从给定上下文生成的对话的多样性。与现有的答案未知型CQG模型相比,所提出的SG-CQG取得了当前最优(state-of-the-art)性能。

英文摘要:

Conversational Question Generation (CQG) is a critical task for machines to assist humans in fulfilling their information needs through conversations. The task is generally cast into two different settings: answer-aware and answer-unaware. While the former facilitates the models by exposing the expected answer, the latter is more realistic and receiving growing attentions recently. What-to-ask and how-to-ask are the two main challenges in the answer-unaware setting. To address the first challenge, existing methods mainly select sequential sentences in context as the rationales. We argue that the conversation generated using such naive heuristics may not be natural enough as in reality, the interlocutors often talk about the relevant contents that are not necessarily sequential in context. Additionally, previous methods decide the type of question to be generated (boolean/span-based) implicitly. Modeling the question type explicitly is crucial as the answer, which hints the models to generate a boolean or span-based question, is unavailable. To this end, we present SG-CQG, a two-stage CQG framework. For the what-to-ask stage, a sentence is selected as the rationale from a semantic graph that we construct, and extract the answer span from it. For the how-to-ask stage, a classifier determines the target answer type of the question via two explicit control signals before generating and filtering. In addition, we propose Conv-Distinct, a novel evaluation metric for CQG, to evaluate the diversity of the generated conversation from a context. Compared with the existing answer-unaware CQG models, the proposed SG-CQG achieves state-of-the-art performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑