Language models are exhibiting increasing capability in knowledge utilization and reasoning. However, when applied as agents in embodied environments, they often suffer from misalignment between their intrinsic knowledge and environmental knowledge, leading to infeasible actions. Traditional environment alignment methods, such as supervised learning on expert trajectories and reinforcement learning, encounter limitations in covering environmental knowledge and achieving efficient convergence, respectively. Inspired by human learning, we propose Exploration-based Error Correction Learning (E2CL), a novel framework that leverages exploration-induced errors and environmental feedback to enhance environment alignment for embodied agents. E2CL incorporates teacher-guided and teacher-free explorations to gather environmental feedback and correct erroneous actions. The agent learns to provide feedback and self-correct, thereby enhancing its adaptability to target environments. Extensive experiments in the VirtualHome environment demonstrate that E2CL-trained agents outperform those trained by baseline methods and exhibit superior self-correction capabilities.
A Survey of Embodied AI: From Simulators to Research Tasks
Nanyang Technological University(南洋理工大学);Singapore University of Technology and Design(新加坡科技设计大学);Institute for Infocomm Research, A*STAR(新加坡科技研究局资讯通信研究院)
UESF-Bench: Benchmarking and Probing for Unified Embodied Seeking and Following
Shandong University(山东大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Qilu University of Technology(齐鲁工业大学);Xiaomi Inc(小米公司);Beijing University Of Technology(北京工业大学);Hong Kong Polytechnic University(香港理工大学)
ConEQsA: Concurrent and Asynchronous Embodied Questions Scheduling and Answering
Software Engineering Institute, East China Normal University(东华大学软件工程学院);Department of Computer Science, Yale University(耶鲁大学计算机科学系);School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);College of Connected Computing, Vanderbilt University(范德比大学连接计算学院)
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Sun Yat-sen University(中山大学);Guangdong Key Laboratory of Big Data Analysis and Processing(广东大数据分析与处理重点实验室);Peng Cheng Laboratory(鹏城实验室);Institute of Digital Media, Peking University(北京大学数字媒体研究院)
FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence
LimX Dynamics;Nankai University(南开大学);The University of Hong Kong(香港大学);University of Electronic Science and Technology of China(电子科技大学);Beijing Institute of Technology(北京理工大学);Xidian University(西安电子科技大学);Zhejiang University(浙江大学);Xi’an Jiaotong University(西安交通大学)
Guava: Distilling Frontier VLMs into a Compact Agent through a Robotic Manipulation Harness
University of Maryland College Park(马里兰大学帕克分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Waterloo(滑铁卢大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Pennsylvania(宾夕法尼亚大学);Amazon FAR(亚马逊 FAR)
Georgia Tech(佐治亚理工学院);Facebook AI Research(Facebook人工智能研究院);Simon Fraser University(西蒙菲莎大学);Imperial College London(帝国理工学院);Princeton University(普林斯顿大学);Intel Labs(英特尔实验室);UC Berkeley(加州大学伯克利分校);Google(谷歌);Allen Institute for AI(艾伦人工智能研究所);University of Washington(华盛顿大学);UC San Diego(加州大学圣地亚哥分校)
Embodied Artificial Intelligence through Distributed Adaptive Control: An Integrated Framework
Universitat Pompeu Fabra(庞培法布拉大学);ICREA(加泰罗尼亚高等研究院);Institute for Bioengineering of Catalonia (IBEC)(加泰罗尼亚生物工程研究所);Barcelona Institute of Science and Technology (BIST)(巴塞罗那科学技术研究所)
Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science and Technology, Beijing Institute of Technology(北京智能信息科技重点实验室,计算机科学与技术学院,北京理工大学);Guangdong Laboratory of Machine Perception and Intelligent Computing, Shenzhen MSU-BIT University(广东机器感知与智能计算实验室,深圳MSU-BIT大学)
Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling
University of California Irvine(加州大学欧文分校);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);Paul G. Allen School of Computer Science(保罗·G·艾伦计算机科学学院)