We present multilingual Pre-trained Machine Reader (mPMR), a novel method for multilingual machine reading comprehension (MRC)-style pre-training. mPMR aims to guide multilingual pre-trained language models (mPLMs) to perform natural language understanding (NLU) including both sequence classification and span extraction in multiple languages. To achieve cross-lingual generalization when only source-language fine-tuning data is available, existing mPLMs solely transfer NLU capability from a source language to target languages. In contrast, mPMR allows the direct inheritance of multilingual NLU capability from the MRC-style pre-training to downstream tasks. Therefore, mPMR acquires better NLU capability for target languages. mPMR also provides a unified solver for tackling cross-lingual span extraction and sequence classification, thereby enabling the extraction of rationales to explain the sentence-pair classification process.
XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags
Ahsanullah University of Science & Technology（阿萨努拉科技大学）；University of Alberta（阿尔伯塔大学）；Université de Sherbrooke（谢布鲁克大学）；Salesforce Research（Salesforce研究院）；Nanyang Technological University（南洋理工大学）
COSMMIC: Comment-Sensitive Multimodal Multilingual Indian Corpus for Summarization and Headline Generation
Department of Computer Science and Engineering, Indian Institute of Technology Patna, India（印度理工学院帕纳分校计算机科学与工程系）；Department of Metallurgical and Materials Engineering, National Institute of Technology Tiruchirappalli, India（印度理工学院 Tiruchirappalli 金属与材料工程系）；Department of Computer Science and Information Systems, BITS Pilani – Goa Campus, India（比斯·帕尼学院 Goa 分校计算机科学与信息系统系）；Department of Computer Science and Engineering, Indian Institute of Information Technology Vadodara, India（印度信息科技学院瓦达拉分校计算机科学与工程系）；Department of Computer Science and Engineering, B.M.S. College of Engineering, Bangalore, India（班加罗尔 B.M.S. 工程学院计算机科学与工程系）；Université de Toulouse, IRIT UMR 5505 CNRS, France（图卢兹大学 IRIT UMR 5505 CNRS 实验室）
Align and Shine: Building High-Quality Sentence-Aligned Corpora for Multilingual Text Simplification
Centre for Translation, Localisation and Interpreting Studies（翻译、本地化与诠释研究中心）；School of Languages, Cultures and Societies（语言、文化和社会学院）；University of Leeds, UK（利兹大学）
