arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.13822cs.CL
收藏

XL-Sum:44种语言的大规模多语言摘要

XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages

Bangladesh University of Engineering Technology (BUET)(孟加拉国工程技术大学(BUET));University of Rochester(罗切斯特大学);Monash University(莫纳什大学);Swinburne University of Technology(斯威本科技大学)

Tahmid Hasan, Abhik Bhattacharjee, Md Saiful Islam, Kazi Samin, Yuan-Fang Li, Yong-Bin Kang, M. Sohel Rahman, Rifat Shahriyar

摘要:

摘要文本摘要的当代工作主要集中在高资源语言,如英语,主要是由于低/中资源的数据集的可用性有限。在这项工作中,我们提出了XL-Sum,一个全面而多样化的数据集,包括来自BBC的100万个专业注释的文章摘要对,使用一组精心设计的语法提取。该数据集涵盖了从低资源到高资源的44种语言,其中许多语言目前没有公共数据集。XL-Sum是高度抽象的,简洁的,高质量的,正如人类和内在的评价所表明的那样。我们使用XL-Sum对mT5进行了微调,这是一种最先进的预训练多语言模型,并在多语言和低资源摘要任务上进行了实验。与使用类似的单语数据集获得的结果相比,XL-Sum诱导了竞争性结果:我们在10种语言上显示出高于11个ROUGE-2分数,其中一些超过了15,如通过多语言训练获得的。此外,单独进行低资源语言的培训也可以提供竞争力。据我们所知,XL-Sum是从单一来源收集的样本数量和覆盖的语言数量方面最大的抽象摘要数据集。我们正在发布我们的数据集和模型,以鼓励未来对多语言摘要的研究。这些资源可在\url{https://github.com/csebuetnlp/xl-sum}上找到。

英文摘要:

Contemporary works on abstractive text summarization have focused primarily on high-resource languages like English, mostly due to the limited availability of datasets for low/mid-resource ones. In this work, we present XL-Sum, a comprehensive and diverse dataset comprising 1 million professionally annotated article-summary pairs from BBC, extracted using a set of carefully designed heuristics. The dataset covers 44 languages ranging from low to high-resource, for many of which no public dataset is currently available. XL-Sum is highly abstractive, concise, and of high quality, as indicated by human and intrinsic evaluation. We fine-tune mT5, a state-of-the-art pretrained multilingual model, with XL-Sum and experiment on multilingual and low-resource summarization tasks. XL-Sum induces competitive results compared to the ones obtained using similar monolingual datasets: we show higher than 11 ROUGE-2 scores on 10 languages we benchmark on, with some of them exceeding 15, as obtained by multilingual training. Additionally, training on low-resource languages individually also provides competitive performance. To the best of our knowledge, XL-Sum is the largest abstractive summarization dataset in terms of the number of samples collected from a single source and the number of languages covered. We are releasing our dataset and models to encourage future research on multilingual abstractive summarization. The resources can be found at \url{https://github.com/csebuetnlp/xl-sum}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑