arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.09227cs.ROcs.AI
收藏

BEHAVIOR-1K:一个以人为中心、包含1,000种日常活动和真实模拟的具身AI基准

BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation

Stanford University(斯坦福大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);The University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Southern California(南加州大学);Salesforce Research(Salesforce研究院)
Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto Martín-Martín, Chen Wang, Gabrael Levine, Wensi Ai, Benjamin Martinez, Hang Yin,… 展开作者

Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto Martín-Martín, Chen Wang, Gabrael Levine, Wensi Ai, Benjamin Martinez, Hang Yin, Michael Lingelbach, Minjune Hwang, Ayano Hiranaka, Sujay Garlanka, Arman Aydin, Sharon Lee, Jiankai Sun, Mona Anvari, Manasi Sharma, Dhruva Bansal, Samuel Hunter, Kyu-Young Kim, Alan Lou, Caleb R Matthews, Ivan Villa-Renteria, Jerry Huayang Tang, Claire Tang, Fei Xia, Yunzhu Li, Silvio Savarese, Hyowon Gweon, C. Karen Liu, Jiajun Wu, Li Fei-Fei

AI总结:

BEHAVIOR-1K是一个以人为中心的具身AI基准,包含1,000种日常活动、50个场景和9,000多个对象,并通过OMNIGIBSON模拟环境支持,旨在挑战长时程复杂操作,为机器人学习提供真实基准。

摘要:

我们提出了BEHAVIOR-1K,一个用于以人为中心的机器人技术的综合模拟基准。BEHAVIOR-1K包含两个组成部分,其指导和动机来源于一项关于“你希望机器人为你做什么?”的广泛调查结果。第一部分是1,000种日常活动的定义,这些活动基于50个场景(房屋、花园、餐厅、办公室等),并配有超过9,000个具有丰富物理和语义属性的对象。第二部分是OMNIGIBSON,一种新颖的模拟环境,通过刚体、可变形体和液体的真实物理模拟和渲染来支持这些活动。我们的实验表明,BEHAVIOR-1K中的活动是长时程的,并且依赖于复杂的操作技能,这两者对于最先进的机器人学习解决方案来说仍然是一个挑战。为了校准BEHAVIOR-1K的模拟到现实差距,我们提供了一项初步研究,将在模拟公寓中通过移动机械臂学到的解决方案迁移到其现实世界对应物。我们希望BEHAVIOR-1K的以人为基础的性质、多样性和真实性使其对具身AI和机器人学习研究有价值。项目网站:https://behavior.stanford.edu。

英文摘要:

We present BEHAVIOR-1K, a comprehensive simulation benchmark for human-centered robotics. BEHAVIOR-1K includes two components, guided and motivated by the results of an extensive survey on "what do you want robots to do for you?". The first is the definition of 1,000 everyday activities, grounded in 50 scenes (houses, gardens, restaurants, offices, etc.) with more than 9,000 objects annotated with rich physical and semantic properties. The second is OMNIGIBSON, a novel simulation environment that supports these activities via realistic physics simulation and rendering of rigid bodies, deformable bodies, and liquids. Our experiments indicate that the activities in BEHAVIOR-1K are long-horizon and dependent on complex manipulation skills, both of which remain a challenge for even state-of-the-art robot learning solutions. To calibrate the simulation-to-reality gap of BEHAVIOR-1K, we provide an initial study on transferring solutions learned with a mobile manipulator in a simulated apartment to its real-world counterpart. We hope that BEHAVIOR-1K's human-grounded nature, diversity, and realism make it valuable for embodied AI and robot learning research. Project website: https://behavior.stanford.edu.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑