arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.10336cs.AIcs.LG
收藏

使用动态感知模型的物理推理

Physical Reasoning Using Dynamics-Aware Models

Facebook AI Research(Facebook人工智能研究院)

Eltayeb Ahmed, Anton Bakhtin, Laurens van der Maaten, Rohit Girdhar

摘要:

解决物理推理任务的一种常见方法是在示例任务上训练值学习器。这种方法的局限性在于,它需要仅从分配给环境的铺开的最终状态的奖励值来学习对象动态。本研究的目的是解决这个限制,通过增加奖励值与自我监督信号的对象动态。具体而言,我们训练模型来表征两个环境推出的相似性,并预测推理任务的结果。这种相似性可以定义为两个卷展栏中对象轨迹之间的距离度量,或者使用对比公式直接从像素中学习。从经验上讲,我们发现这种方法导致物理推理的PHYRE基准的实质性性能改进(Bakhtin等人,2019年),建立一个新的国家的最先进的。

英文摘要:

A common approach to solving physical reasoning tasks is to train a value learner on example tasks. A limitation of such an approach is that it requires learning about object dynamics solely from reward values assigned to the final state of a rollout of the environment. This study aims to address this limitation by augmenting the reward value with self-supervised signals about object dynamics. Specifically, we train the model to characterize the similarity of two environment rollouts, jointly with predicting the outcome of the reasoning task. This similarity can be defined as a distance measure between the trajectory of objects in the two rollouts, or learned directly from pixels using a contrastive formulation. Empirically, we find that this approach leads to substantial performance improvements on the PHYRE benchmark for physical reasoning (Bakhtin et al., 2019), establishing a new state-of-the-art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑