Enabling humanoid robots to perform autonomously loco-manipulation in unstructured environments is crucial and highly challenging for achieving embodied intelligence. This involves robots being able to plan their actions and behaviors in long-horizon tasks while using multi-modality to perceive deviations between task execution and high-level planning. Recently, large language models (LLMs) have demonstrated powerful planning and reasoning capabilities for comprehension and processing of semantic information through robot control tasks, as well as the usability of analytical judgment and decision-making for multi-modal inputs. To leverage the power of LLMs towards humanoid loco-manipulation, we propose a novel language-model based framework that enables robots to autonomously plan behaviors and low-level execution under given textual instructions, while observing and correcting failures that may occur during task execution. To systematically evaluate this framework in grounding LLMs, we created the robot 'action' and 'sensing' behavior library for task planning, and conducted mobile manipulation tasks and experiments in both simulated and real environments using the CENTAURO robot, and verified the effectiveness and application of this approach in robotic tasks with autonomous behavioral planning.
BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholds
Shanghai AI Laboratory（上海人工智能实验室）；Shanghai Jiao Tong University（上海交通大学）；Zhejiang University（浙江大学）；The University of Hong Kong（香港大学）；The Chinese University of Hong Kong（香港中文大学）
Humanoid Agent via Embodied Chain-of-Action Reasoning with Multimodal Foundation Models for Zero-Shot Loco-Manipulation
Embodied AI and Robotics (AIR) Lab, New York University, New York, USA and NYUAD Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, UAE（纽约大学Embodied AI和机器人实验室及纽约大学阿布扎赫尔人工智能与机器人中心）；Harvard AI and Robotics Lab, Harvard University, Boston, USA（哈佛大学人工智能与机器人实验室）；Department of Computer Science, University College London, London, UK（伦敦大学学院计算机科学系）；Department of Computer Science, University of Liverpool, UK（利物浦大学计算机科学系）；NYUAD Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, UAE（纽约大学阿布扎赫尔人工智能与机器人中心）
StyleLoco: Generative Adversarial Distillation for Natural Humanoid Robot Locomotion
National Key Laboratory of General Artificial Intelligence, BIGAI（通用人工智能国家重点实验室，BIGAI）；School of Control Science and Engineering, Shandong University（山东大学控制科学与工程学院）；Huazhong University of Science and Technology（华中科技大学）
Humanoid Loco-manipulation Planning based on Graph Search and Reachability Maps
CNRS-AIST JRL (Joint Robotics Laboratory)（CNRS-AIST联合机器人实验室）；IRL（机器人研究所）；National Institute of Advanced Industrial Science and Technology (AIST)（国家先进工业科学与技术研究院）
EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation
OpenDriveLab at The University of Hong Kong（香港大学OpenDriveLab）；Alibaba Group（阿里巴巴集团）；Shanghai Innovation Institute（上海创新研究院）；Fudan University（复旦大学）；Beihang University（北京航空航天大学）；Sichuan University（四川大学）；Archon Robotics（Archon机器人公司）
OASIS: From Simulation Data Collection to Real-World Humanoid Loco-Manipulation
Institute of Artificial Intelligence (TeleAI), China Telecom（中国电信人工智能研究院（TeleAI））；Fudan University（复旦大学）；East China University of Science and Technology（华东理工大学）；Shanghai Jiao Tong University（上海交通大学）
MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotion
Faculty of Robot Science and Engineering, Northeastern University（机器人科学与工程学院，东北大学）；Guangdong Key Laboratory of Intelligent Morphing Mechanisms and Adaptive Robotics and School of Intelligence Science and Engineering, the Harbin Institute of Technology Shenzhen（智能变形机制与适应机器人重点实验室和智能科学与工程学院，哈尔滨工业大学深圳）
HWC-Loco: A Hierarchical Whole-Body Control Approach to Robust Humanoid Locomotion
The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））；Harbin Institute of Technology（哈尔滨工业大学）；DexForce Technology（DexForce科技）；Southeast University（东南大学）
State Estimation for Human Motion and Humanoid Locomotion
Istituto Italiano di Tecnologia（意大利理工学院）；IRI CSIC-UPC（西班牙国家研究委员会-加泰罗尼亚理工大学机器人研究所）；AIST（日本产业技术综合研究所）；LAAS-CNRS（法国国家科学研究中心系统分析与架构实验室）；DIBRIS-UNIGE（热那亚大学计算机、生物工程、机器人与系统工程系）
GM-Loco: Terrain-Adaptive Humanoid Locomotion on Granular Media
Institute for Robotics and Intelligent Machines, Georgia Institute of Technology（佐治亚理工学院机器人与智能机器研究所）；School of Physics, Georgia Institute of Technology（佐治亚理工学院物理学院）；Northeastern University（东北大学）
