arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.01401cs.CL
收藏

XGLUE:一种新的跨语言预训练、理解和生成基准数据集

XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation

Microsoft(微软公司)
Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal,… 展开作者

Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Ying Qiao, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Daniel Campos, Rangan Majumder, Ming Zhou

摘要:

在本文中,我们介绍了XGLUE,这是一个新的基准数据集,可用于使用多语言和双语语料库训练大规模跨语言预训练模型,并评估它们在各种跨语言任务中的性能。与GLUE(Wang等人,2019),仅针对自然语言理解任务进行英文标注,XGLUE主要有两大优势:(1)提供11个多样化任务,涵盖自然语言理解和生成场景;(2)针对每个任务,提供多种语言的标注数据。我们扩展了最近的跨语言预训练模型Unicoder(Huang et al.,2019年),以涵盖理解和生成任务,这是对XGLUE作为一个强大的基线进行评估。我们还评估了多语言BERT,XLM和XLM-R的基础版本(12层)进行比较。

英文摘要:

In this paper, we introduce XGLUE, a new benchmark dataset that can be used to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora and evaluate their performance across a diverse set of cross-lingual tasks. Comparing to GLUE(Wang et al., 2019), which is labeled in English for natural language understanding tasks only, XGLUE has two main advantages: (1) it provides 11 diversified tasks that cover both natural language understanding and generation scenarios; (2) for each task, it provides labeled data in multiple languages. We extend a recent cross-lingual pre-trained model Unicoder(Huang et al., 2019) to cover both understanding and generation tasks, which is evaluated on XGLUE as a strong baseline. We also evaluate the base versions (12-layer) of Multilingual BERT, XLM and XLM-R for comparison.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑