arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.06310cs.CLcs.LG
收藏

MeetSum:使用Transformers转换会议记录摘要!

MeetSum: Transforming Meeting Transcript Summarization using Transformers!

University of Waterloo(滑铁卢大学)

Nima Sadri, Bohan Zhang, Bihan Liu

摘要:

由于可用于训练神经网络模型的标记数据量有限,因此从会议记录创建抽象摘要已被证明是具有挑战性的。此外,基于transformer的架构已被证明在总结新闻数据方面击败了最先进的模型。在本文中,我们利用一个基于转换器的指针生成器网络来生成会议记录的摘要。该模型使用两个LSTM作为编码器和解码器,一个指针网络从输入的文本中复制单词,一个生成器网络生成词汇表外的单词(因此使摘要抽象)。此外,使用覆盖机制来避免所生成的摘要中的单词重复。首先,我们证明了在新闻摘要数据集上训练模型,并使用零样本学习在会议数据集上测试它,比在AMI会议数据集上训练它产生更好的结果。其次,我们证明了首先在域外数据(如CNN-Dailymail数据集)上训练该模型,然后在AMI会议数据集上进行微调,能够显着提高模型的性能。我们在AMI数据集的测试集上测试了我们的模型,并报告了生成的摘要的ROUGE-2评分,以与以前的文献进行比较。我们还报告了我们的摘要的事实得分,因为它是抽象摘要的更好基准,因为ROUGE-2得分仅限于测量单词重叠。我们表明,我们的改进模型是能够提高以前的模型至少5个ROUGE-2分数,这是一个实质性的改进。此外,对我们的模型生成的摘要的定性分析表明,这些摘要是人类可读的,并且确实从成绩单中捕获了大部分重要信息。

英文摘要:

Creating abstractive summaries from meeting transcripts has proven to be challenging due to the limited amount of labeled data available for training neural network models. Moreover, Transformer-based architectures have proven to beat state-of-the-art models in summarizing news data. In this paper, we utilize a Transformer-based Pointer Generator Network to generate abstract summaries for meeting transcripts. This model uses 2 LSTMs as an encoder and a decoder, a Pointer network which copies words from the inputted text, and a Generator network to produce out-of-vocabulary words (hence making the summary abstractive). Moreover, a coverage mechanism is used to avoid repetition of words in the generated summary. First, we show that training the model on a news summary dataset and using zero-shot learning to test it on the meeting dataset proves to produce better results than training it on the AMI meeting dataset. Second, we show that training this model first on out-of-domain data, such as the CNN-Dailymail dataset, followed by a fine-tuning stage on the AMI meeting dataset is able to improve the performance of the model significantly. We test our model on a testing set from the AMI dataset and report the ROUGE-2 score of the generated summary to compare with previous literature. We also report the Factual score of our summaries since it is a better benchmark for abstractive summaries since the ROUGE-2 score is limited to measuring word-overlaps. We show that our improved model is able to improve on previous models by at least 5 ROUGE-2 scores, which is a substantial improvement. Also, a qualitative analysis of the summaries generated by our model shows that these summaries and human-readable and indeed capture most of the important information from the transcripts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑