arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.09692cs.AIcs.LG
收藏

Hi-Phy:层次物理推理的基准

Hi-Phy: A Benchmark for Hierarchical Physical Reasoning

Cheng Xue, Vimukthini Pinto, Chathura Gamage, Peng Zhang, Jochen Renz

摘要:

对物理对象行为的推理是在物理世界中操作的代理的关键能力。人类在物理推理方面非常有经验,但这仍然是人工智能面临的一个重大挑战。为了促进解决这一问题的研究,最近提出了几个基准。然而,这些基准测试并不能使我们在解决复杂的推理任务时测量代理的粒度物理推理能力。在本文中,我们提出了一个新的基准物理推理,使我们能够测试个人的物理推理能力。受人类如何获得这些能力的启发,我们提出了一个一般层次的物理推理能力,越来越复杂。我们的基准测试功能,根据这个层次结构,通过生成的物理推理任务,在视频游戏愤怒的小鸟。该基准测试使我们能够通过测量代理的粒度物理推理能力来进行全面的代理评估。我们与人类玩家,学习代理和启发式代理进行评估,并确定他们的能力。我们的评估表明,学习代理,具有良好的局部泛化能力,仍然很难学习底层的物理推理能力,表现不如目前最先进的启发式代理和人类。我们相信,这个基准将鼓励研究人员开发具有先进的、类似人类的物理推理能力的智能代理。网址:https://github.com/Cheng-Xue/Hi-Phy

英文摘要:

Reasoning about the behaviour of physical objects is a key capability of agents operating in physical worlds. Humans are very experienced in physical reasoning while it remains a major challenge for AI. To facilitate research addressing this problem, several benchmarks have been proposed recently. However, these benchmarks do not enable us to measure an agent's granular physical reasoning capabilities when solving a complex reasoning task. In this paper, we propose a new benchmark for physical reasoning that allows us to test individual physical reasoning capabilities. Inspired by how humans acquire these capabilities, we propose a general hierarchy of physical reasoning capabilities with increasing complexity. Our benchmark tests capabilities according to this hierarchy through generated physical reasoning tasks in the video game Angry Birds. This benchmark enables us to conduct a comprehensive agent evaluation by measuring the agent's granular physical reasoning capabilities. We conduct an evaluation with human players, learning agents, and heuristic agents and determine their capabilities. Our evaluation shows that learning agents, with good local generalization ability, still struggle to learn the underlying physical reasoning capabilities and perform worse than current state-of-the-art heuristic agents and humans. We believe that this benchmark will encourage researchers to develop intelligent agents with advanced, human-like physical reasoning capabilities. URL: https://github.com/Cheng-Xue/Hi-Phy

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑