arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.08770cs.IR
收藏

TSSuBERT:使用BERT的推文流摘要

TSSuBERT: Tweet Stream Summarization Using BERT

Alexis Dusart, Karen Pinel-Sauvagnat, Gilles Hubert

摘要:

深度神经网络的发展和预先训练的语言模型(如BERT)的出现可以提高许多NLP任务的性能。然而,这些模型并不符合tweet摘要的相同流行度,这可能是因为缺乏现有的训练和评估集合。我们在本文中的贡献是双重的:(1)我们引入了一个用于Twitter事件摘要的大型数据集,以及(2)我们提出了一个神经模型来自动总结巨大的推文流。该提取模型以原始的方式结合了预训练的语言模型和基于词汇频率的表示来预测推文显著性。该模型的另一个优点是,它可以根据输入的tweet流自动调整输出摘要的大小。我们使用两个不同的Twitter集合进行了实验,与最先进的基线相比,观察到了有希望的结果。

英文摘要:

The development of deep neural networks and the emergence of pre-trained language models such as BERT allow to increase performance on many NLP tasks. However, these models do not meet the same popularity for tweet summarization, which can probably be explained by the lack of existing collections for training and evaluation. Our contribution in this paper is twofold : (1) we introduce a large dataset for Twitter event summarization, and (2) we propose a neural model to automatically summarize huge tweet streams. This extractive model combines in an original way pre-trained language models and vocabulary frequency-based representations to predict tweet salience. An additional advantage of the model is that it automatically adapts the size of the output summary according to the input tweet stream. We conducted experiments using two different Twitter collections, and promising results are observed in comparison with state-of-the-art baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑