arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1506.06833cs.CLcs.AIcs.CV
收藏

视觉和语言研究的现有数据集综述

A Survey of Current Datasets for Vision and Language Research

Microsoft Research(微软研究院);Johns Hopkins University(约翰霍普金斯大学);University of Rochester(罗切斯特大学);Carnegie Mellon University(卡内基梅隆大学)

Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao, Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell

摘要:

整合视觉和语言一直是人工智能(AI)工作的梦想。在过去的两年里,我们见证了一场爆炸式的工作,将视觉和语言从图像到视频等融合在一起。可用的语料库在推进这一研究领域发挥了至关重要的作用。在本文中,我们提出了一套质量指标来评估和分析视觉和语言数据集,并相应地对它们进行分类。我们的分析表明,最新的数据集使用了更复杂的语言和更抽象的概念,然而,每个数据集都有不同的优点和缺点。

英文摘要:

Integrating vision and language has long been a dream in work on artificial intelligence (AI). In the past two years, we have witnessed an explosion of work that brings together vision and language from images to videos and beyond. The available corpora have played a crucial role in advancing this area of research. In this paper, we propose a set of quality metrics for evaluating and analyzing the vision & language datasets and categorize them accordingly. Our analyses show that the most recent datasets have been using more complex language and more abstract concepts, however, there are different strengths and weaknesses in each.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑