arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.03760cs.CL
收藏

DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement

Queen’s University(女王大学);University of Science and Technology of China(中国科学技术大学);iFLYTEK Research(科大讯飞研究院)

Tianda Li, Jia-Chen Gu, Xiaodan Zhu, Quan Liu, Zhen-Hua Ling, Zhiming Su, Si Wei

英文摘要:

Disentanglement is a problem in which multiple conversations occur in the same channel simultaneously, and the listener should decide which utterance is part of the conversation he will respond to. We propose a new model, named Dialogue BERT (DialBERT), which integrates local and global semantics in a single stream of messages to disentangle the conversations that mixed together. We employ BERT to capture the matching information in each utterance pair at the utterance-level, and use a BiLSTM to aggregate and incorporate the context-level information. With only a 3% increase in parameters, a 12% improvement has been attained in comparison to BERT, based on the F1-Score. The model achieves a state-of-the-art result on the a new dataset proposed by IBM and surpasses previous work by a substantial margin.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑