arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.05812cs.CLcs.AIcs.LG
收藏

MLR:一个支持多任务学习的两阶段会话查询重写模型

MLR: A Two-stage Conversational Query Rewriting Model with Multi-task Learning

Alibaba Group(阿里巴巴集团)

Shuangyong Song, Chao Wang, Qianqian Xie, Xinxing Zu, Huan Chen, Haiqing Chen

摘要:

会话语境理解的目的是从会话历史中识别用户的真实意图,这对建立对话系统至关重要。然而,开放领域中的多轮会话理解仍然具有相当大的挑战性,这需要系统提取重要信息并解决各种开放主题之间的上下文依赖关系。在本文中,我们提出了会话查询重写模型- MLR,这是一个多任务模型的序列标记和查询重写。MLR将多轮会话查询转化为单轮查询,简洁地表达了用户的真实意图,降低了多轮会话建模的难度。在该模型中,我们制定了查询重写作为一个序列生成问题,并通过辅助词类别标签预测任务引入词类别信息。为了对模型进行训练,我们构造了一个新的中文查询重写数据集,并在该数据集上进行了实验,实验结果表明,该模型的性能优于其他模型,证明了词类别信息在提高重写性能方面的有效性。

英文摘要:

Conversational context understanding aims to recognize the real intention of user from the conversation history, which is critical for building the dialogue system. However, the multi-turn conversation understanding in open domain is still quite challenging, which requires the system extracting the important information and resolving the dependencies in contexts among a variety of open topics. In this paper, we propose the conversational query rewriting model - MLR, which is a Multi-task model on sequence Labeling and query Rewriting. MLR reformulates the multi-turn conversational queries into a single turn query, which conveys the true intention of users concisely and alleviates the difficulty of the multi-turn dialogue modeling. In the model, we formulate the query rewriting as a sequence generation problem and introduce word category information via the auxiliary word category label predicting task. To train our model, we construct a new Chinese query rewriting dataset and conduct experiments on it. The experimental results show that our model outperforms compared models, and prove the effectiveness of the word category information in improving the rewriting performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑