arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.04293cs.AIcs.CLcs.CV
收藏

CRAFT:力的因果推理基准及inTeractions

CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions

Hacettepe University(哈塞特佩大学);Koç University(科奇大学)

Tayfun Ates, M. Samil Atesoglu, Cagatay Yigit, Ilker Kesen, Mert Kobas, Erkut Erdem, Aykut Erdem, Tilbe Goksun, Deniz Yuret

摘要:

人类能够感知、理解和推理因果事件。开发具有相似物理和因果理解能力的模型是人工智能的长期目标。作为朝着这个方向迈出的一步,我们介绍了CRAFT,一个新的视频问答数据集,需要因果推理的物理力量和对象的相互作用。它包含58K视频和问题对,这些视频和问题对是从20个不同的虚拟环境中的10K视频中生成的,其中包含各种运动中的物体,这些物体彼此之间以及场景之间进行交互。CRAFT中的两个问题类别包括先前研究的描述性问题和反事实问题。此外,受认知语言学中的力动力学理论的启发,我们引入了一个新的因果问题类别,涉及通过原因,使能和防止等概念来理解对象之间的因果相互作用。我们的研究结果表明,尽管CRAFT中的问题对人类来说很容易,但测试的基线模型,包括现有的最先进的方法,还没有处理我们的基准测试中提出的挑战。

英文摘要:

Humans are able to perceive, understand and reason about causal events. Developing models with similar physical and causal understanding capabilities is a long-standing goal of artificial intelligence. As a step towards this direction, we introduce CRAFT, a new video question answering dataset that requires causal reasoning about physical forces and object interactions. It contains 58K video and question pairs that are generated from 10K videos from 20 different virtual environments, containing various objects in motion that interact with each other and the scene. Two question categories in CRAFT include previously studied descriptive and counterfactual questions. Additionally, inspired by the Force Dynamics Theory in cognitive linguistics, we introduce a new causal question category that involves understanding the causal interactions between objects through notions like cause, enable, and prevent. Our results show that even though the questions in CRAFT are easy for humans, the tested baseline models, including existing state-of-the-art methods, do not yet deal with the challenges posed in our benchmark.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑