arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.14712cs.CLcs.AI
收藏

Bloom Library:300多种语言的多模式数据集,用于各种下游任务

Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Tasks

University of Dayton Research Institute(代顿大学研究院);SIL International(国际暑期语言学院);TU Darmstadt(达姆施塔特工业大学);Masakhane

Colin Leong, Joshua Nemecek, Jacob Mansdorfer, Anna Filighera, Abraham Owodunni, Daniel Whitenack

摘要:

我们提出了布鲁姆图书馆,语言多样化的一组多模态和多语言数据集的语言建模,图像描述,视觉讲故事,和语音合成/识别。这些数据集代表了每个包含的下游任务的最多或最多的多语言数据集。总体而言,Bloom Library数据集的初始版本涵盖了32个语言家族的363种语言。我们为数据中表示的各种语言训练下游任务模型,显示数据在低资源,多模态NLP中未来工作的可行性,并为某些语言(例如,Bisu [bzi],估计有700名用户)。其中一些首创的基线可以与高资源语言的最先进性能相媲美。Bloom Library数据集在Creative Commons许可下在Hugging Face数据集中心发布,以促进下游任务中更多语言多样性的研究。

英文摘要:

We present Bloom Library, a linguistically diverse set of multimodal and multilingual datasets for language modeling, image captioning, visual storytelling, and speech synthesis/recognition. These datasets represent either the most, or among the most, multilingual datasets for each of the included downstream tasks. In total, the initial release of the Bloom Library datasets covers 363 languages across 32 language families. We train downstream task models for various languages represented in the data, showing the viability of the data for future work in low-resource, multimodal NLP and establishing the first known baselines for these downstream tasks in certain languages (e.g., Bisu [bzi], with an estimated population of 700 users). Some of these first-of-their-kind baselines are comparable to state-of-the-art performance for higher-resourced languages. The Bloom Library datasets are released under Creative Commons licenses on the Hugging Face datasets hub to catalyze more linguistically diverse research in the included downstream tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑