arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.06180cs.AIcs.CV
收藏

SPACE:三维环境中物理交互和因果学习的模拟器

SPACE: A Simulator for Physical Interactions and Causal Learning in 3D Environments

Nanyang Technological University(南洋理工大学);Singapore University of Technology and Design(新加坡科技设计大学);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局(A*STAR))

Jiafei Duan, Samson Yu Bai Jian, Cheston Tan

摘要:

深度学习、计算机视觉和嵌入式AI的最新进展已经产生了合成因果推理视频数据集。这些数据集促进了人工智能算法的开发,这些算法可以推理对象之间的物理交互。然而,到目前为止,数据集主要集中在基本的物理事件,如滚动或下降。目前缺乏专注于人类日常与现实世界中的对象进行物理交互的数据集。为了解决这一问题,我们介绍了空间:3D环境中物理交互和因果学习的模拟器。SPACE模拟器允许我们生成SPACE数据集,这是一个3D环境中的合成视频数据集,可以在一系列物理因果推理任务中系统地评估基于物理的模型。SPACE数据集的灵感来自于日常物体的相互作用,它包括描述三种类型的物理事件的视频:包容性,稳定性和接触。这些事件构成了物体之间基本物理相互作用的绝大多数。然后,我们使用最先进的基于物理学的深度模型对其进行进一步评估,并表明SPACE数据集通过受课程学习启发的方法改善了直观物理学的学习。资料档案库:https://github.com/jiafei1224/SPACE

英文摘要:

Recent advancements in deep learning, computer vision, and embodied AI have given rise to synthetic causal reasoning video datasets. These datasets facilitate the development of AI algorithms that can reason about physical interactions between objects. However, datasets thus far have primarily focused on elementary physical events such as rolling or falling. There is currently a scarcity of datasets that focus on the physical interactions that humans perform daily with objects in the real world. To address this scarcity, we introduce SPACE: A Simulator for Physical Interactions and Causal Learning in 3D Environments. The SPACE simulator allows us to generate the SPACE dataset, a synthetic video dataset in a 3D environment, to systematically evaluate physics-based models on a range of physical causal reasoning tasks. Inspired by daily object interactions, the SPACE dataset comprises videos depicting three types of physical events: containment, stability and contact. These events make up the vast majority of the basic physical interactions between objects. We then further evaluate it with a state-of-the-art physics-based deep model and show that the SPACE dataset improves the learning of intuitive physics with an approach inspired by curriculum learning. Repository: https://github.com/jiafei1224/SPACE

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑