PMIndiaSum:面向印度语言的多语言与跨语言标题摘要
PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in India
AI总结:
本文提出PMIndiaSum,一个覆盖4个语系、14种语言和196个语言对的大规模平行多语言摘要语料库,通过微调、提示等方法构建基准,证实了该数据在辅助印度语言间摘要任务中的关键作用。
摘要:
本文介绍了PMIndiaSum,一个专注于印度语言的多语言和大规模平行摘要语料库。我们的语料库为4个语系、14种语言提供了训练和测试环境,并包含迄今为止最多的196个语言对。我们详细说明了构建工作流程,包括数据获取、处理和质量保证。此外,我们通过微调、提示以及翻译加摘要的方法,发布了单语、跨语言和多语言摘要的基准。实验结果证实了我们的数据在辅助印度语言间摘要方面的关键作用。我们的数据集是公开可用的,可以被自由修改和重新分发。
英文摘要:
This paper introduces PMIndiaSum, a multilingual and massively parallel summarization corpus focused on languages in India. Our corpus provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. We detail our construction workflow including data acquisition, processing, and quality assurance. Furthermore, we publish benchmarks for monolingual, cross-lingual, and multilingual summarization by fine-tuning, prompting, as well as translate-and-summarize. Experimental results confirm the crucial role of our data in aiding summarization between Indian languages. Our dataset is publicly available and can be freely modified and re-distributed.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。