arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.06376cs.LGstat.ML
收藏

MLM:多语言多模态多任务学习的基准数据集

MLM: A Benchmark Dataset for Multitask Learning with Multiple Languages and Modalities

University of Bonn(波恩大学);Jožef Stefan Institute(约瑟夫·斯特凡研究所);Fraunhofer IAIS(弗劳恩霍夫应用信息学和交互系统研究所)

Jason Armitage, Endri Kacupaj, Golsa Tahmasebzadeh, Swati, Maria Maleshkova, Ralph Ewerth, Jens Lehmann

摘要:

在本文中,我们介绍了MLM(多语言和模态)数据集-一个新的资源,训练和评估多任务系统的样本在多个模态和三种语言。语义数据的生成过程和包含提供了进一步测试多任务系统学习实体之间关系的能力的资源。该数据集专为研究人员和开发人员设计,他们构建应用程序,对网络和数字档案中遇到的数据执行多项任务。MLM的第二个版本提供了一个具有地理代表性的数据子集,并为欧盟国家提供了加权样本。我们展示了资源的价值,在开发新的应用程序中的数字人文与激励用例,并指定一组基准任务,以检索模态和定位实体的数据集。基线多任务和单任务系统的完整和地理代表性版本的MLM的评估表明,在不同的数据概括的挑战。除了数字人文,我们希望资源有助于多模态表示学习,位置估计和场景理解的研究。

英文摘要:

In this paper, we introduce the MLM (Multiple Languages and Modalities) dataset - a new resource to train and evaluate multitask systems on samples in multiple modalities and three languages. The generation process and inclusion of semantic data provide a resource that further tests the ability for multitask systems to learn relationships between entities. The dataset is designed for researchers and developers who build applications that perform multiple tasks on data encountered on the web and in digital archives. A second version of MLM provides a geo-representative subset of the data with weighted samples for countries of the European Union. We demonstrate the value of the resource in developing novel applications in the digital humanities with a motivating use case and specify a benchmark set of tasks to retrieve modalities and locate entities in the dataset. Evaluation of baseline multitask and single task systems on the full and geo-representative versions of MLM demonstrate the challenges of generalising on diverse data. In addition to the digital humanities, we expect the resource to contribute to research in multimodal representation learning, location estimation, and scene understanding.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑