arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1410.8027cs.AIcs.CLcs.CVcs.LG
收藏

迈向视觉图灵挑战

Towards a Visual Turing Challenge

Max Planck Institute for Informatics(马克斯·普朗克信息学研究所)

Mateusz Malinowski, Mario Fritz

摘要:

随着机器对语言和视觉理解的快速发展,我们发现人们对整体架构越来越感兴趣,这种架构在联合学习和推理过程中将两种模式紧密联系在一起。这一趋势使社区能够朝着更具挑战性和开放性的任务发展,并为实现旧的AI梦想提供了动力,即构建可以在开放领域通过图灵测试的机器。为了稳步实现这一目标,我们认识到量化业绩变得越来越困难。因此,我们要问,我们如何才能准确地定义这样的挑战,我们如何才能评估不同的算法在这个开放的任务?在本文中,我们总结和讨论这些挑战,并试图在文献中提供适当的选项,给出答案。我们在最近提出的基于真实世界室内图像的问答任务数据集上验证了一些解决方案,建立了一个视觉图灵挑战。最后,我们认为,尽管独特的地面实况注释取得了成功,但我们可能不得不远离精心策划的数据集,而是依靠“社会共识”作为创建合适基准的主要驱动力。在这一本来就不明确的产出领域提供覆盖面,是我们在这一领域取得可量化进展所面临的一个新挑战。

英文摘要:

As language and visual understanding by machines progresses rapidly, we are observing an increasing interest in holistic architectures that tightly interlink both modalities in a joint learning and inference process. This trend has allowed the community to progress towards more challenging and open tasks and refueled the hope at achieving the old AI dream of building machines that could pass a turing test in open domains. In order to steadily make progress towards this goal, we realize that quantifying performance becomes increasingly difficult. Therefore we ask how we can precisely define such challenges and how we can evaluate different algorithms on this open tasks? In this paper, we summarize and discuss such challenges as well as try to give answers where appropriate options are available in the literature. We exemplify some of the solutions on a recently presented dataset of question-answering task based on real-world indoor images that establishes a visual turing challenge. Finally, we argue despite the success of unique ground-truth annotation, we likely have to step away from carefully curated dataset and rather rely on 'social consensus' as the main driving force to create suitable benchmarks. Providing coverage in this inherently ambiguous output space is an emerging challenge that we face in order to make quantifiable progress in this area.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑