BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation
Stanford University(斯坦福大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);The University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Southern California(南加州大学);Salesforce Research(Salesforce研究院)
Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto Martín-Martín, Chen Wang, Gabrael Levine, Wensi Ai, Benjamin Martinez, Hang Yin,… 展开作者
Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto Martín-Martín, Chen Wang, Gabrael Levine, Wensi Ai, Benjamin Martinez, Hang Yin, Michael Lingelbach, Minjune Hwang, Ayano Hiranaka, Sujay Garlanka, Arman Aydin, Sharon Lee, Jiankai Sun, Mona Anvari, Manasi Sharma, Dhruva Bansal, Samuel Hunter, Kyu-Young Kim, Alan Lou, Caleb R Matthews, Ivan Villa-Renteria, Jerry Huayang Tang, Claire Tang, Fei Xia, Yunzhu Li, Silvio Savarese, Hyowon Gweon, C. Karen Liu, Jiajun Wu, Li Fei-Fei
We present BEHAVIOR-1K, a comprehensive simulation benchmark for human-centered robotics. BEHAVIOR-1K includes two components, guided and motivated by the results of an extensive survey on "what do you want robots to do for you?". The first is the definition of 1,000 everyday activities, grounded in 50 scenes (houses, gardens, restaurants, offices, etc.) with more than 9,000 objects annotated with rich physical and semantic properties. The second is OMNIGIBSON, a novel simulation environment that supports these activities via realistic physics simulation and rendering of rigid bodies, deformable bodies, and liquids. Our experiments indicate that the activities in BEHAVIOR-1K are long-horizon and dependent on complex manipulation skills, both of which remain a challenge for even state-of-the-art robot learning solutions. To calibrate the simulation-to-reality gap of BEHAVIOR-1K, we provide an initial study on transferring solutions learned with a mobile manipulator in a simulated apartment to its real-world counterpart. We hope that BEHAVIOR-1K's human-grounded nature, diversity, and realism make it valuable for embodied AI and robot learning research. Project website: https://behavior.stanford.edu.
P-RAG: Progressive Retrieval Augmented Generation For Planning on Embodied Everyday Task
University of Science and Technology of China(中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
NOIR 2.0: Neural Signal Operated Intelligent Robots for Everyday Activities
Institute for Computational and Mathematical Engineering(计算与数学工程研究所);Department of Computer Science(计算机科学系);Department of Mechanical Engineering(机械工程系)
NormAct: Benchmarking Embodied Agents' Proactive Compliance with Unspoken Social Norms
State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI)(通用人工智能国家重点实验室,北京通用人工智能研究院);China Academy of Information and Communications Technology(中国信息通信研究院);ShanghaiTech University(上海科技大学)
EmbodiedClaw: Conversational Workflow Execution for Embodied AI Development
School of Cyber Science and Engineering, Huazhong University of Science and Technology(华中科技大学信息科学与工程学院);School of Mechanical Science and Engineering, Huazhong University of Science and Technology(华中科技大学机械科学与工程学院);School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院);Lehigh University(莱斯大学);College of AI, Tsinghua University(清华大学人工智能学院)
Position: Robot Privacy as Embodied Boundary Work. Connecting Capabilities, Contexts, and Design Responses in Everyday Robotics
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Tsinghua University(清华大学);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);The Hong Kong University of Science and Technology(香港科技大学)
Agent AI: Surveying the Horizons of Multimodal Interaction
Microsoft Gaming(微软游戏);University of California, Los Angeles(加州大学洛杉矶分校);University of Washington(华盛顿大学);Microsoft Research, Redmond(微软研究院(雷德蒙德));Stanford University(斯坦福大学)
From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?
Institute of AI and Autonomous Systems (A 2 S)(人工智能与自主系统研究所);Hochschule Bonn-Rhein-Sieg(波恩-莱茵-锡格大学);Division for Systems and Control(系统与控制系);Chalmers University of Technology(查尔姆斯理工大学);Fraunhofer Institute for Intelligent Analysis and Information Systems(弗劳恩霍夫智能分析与信息系统研究所)