arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.01159cs.CL
收藏

TLDR9 +:用于社交媒体帖子极端摘要的大规模资源

TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts

Adobe Research(奥多比研究院);Georgetown University(乔治敦大学)

Sajad Sotudeh, Hanieh Deilamsalehy, Franck Dernoncourt, Nazli Goharian

摘要:

摘要系统开发中的最新模型由数百万个参数组成,并且模型性能高度依赖于训练数据的丰富程度。虽然大多数现有的摘要语料库包含数千到一百万的数量级的数据,但数百万数量级的大规模摘要数据集的生成还有待探索。实际上,更多的数据更好地将训练模式推广到看不见的数据。在本文中,我们介绍了TLDR 9 + -一个大规模的摘要数据集-包含从Reddit论坛(https://github.com/sajastu/reddit_collector)提取的超过900万个训练实例。该数据集被专门收集以执行极端总结(即,以高压缩和抽象生成一句话摘要),并且比先前提出的数据集大两倍以上。我们更进一步,在人工注释的帮助下,我们通过从TLDR 9+中采样高质量实例来提取更细粒度的数据集,并将其称为TLDRHQ数据集。我们进一步确定了我们提出的数据集上不同的最先进的摘要模型。

英文摘要:

Recent models in developing summarization systems consist of millions of parameters and the model performance is highly dependent on the abundance of training data. While most existing summarization corpora contain data in the order of thousands to one million, generation of large-scale summarization datasets in order of couple of millions is yet to be explored. Practically, more data is better at generalizing the training patterns to unseen data. In this paper, we introduce TLDR9+ -- a large-scale summarization dataset -- containing over 9 million training instances extracted from Reddit discussion forum (https://github.com/sajastu/reddit_collector). This dataset is specifically gathered to perform extreme summarization (i.e., generating one-sentence summary in high compression and abstraction) and is more than twice larger than the previously proposed dataset. We go one step further and with the help of human annotations, we distill a more fine-grained dataset by sampling High-Quality instances from TLDR9+ and call it TLDRHQ dataset. We further pinpoint different state-of-the-art summarization models on our proposed datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑