STEP: Spatiotemporal Training with Explicit Prediction for Perceptive Humanoid Locomotion
Beijing University of Chemical Technology (BUCT)(北京化工大学);National University of Defense Technology (NUDT)(中国人民解放军国防科技大学);Noetix Robotics(诺泰克斯机器人公司);University of Science and Technology of China (USTC)(中国科学技术大学)
For perceptive humanoid locomotion, the relevance of terrain geometry depends on the robot's body state and how both evolve under its actions. Existing work has advanced terrain-aware sensory fusion and cross-modal prediction, improving how visual and proprioceptive information is combined and related. However, feature aggregation alone does not specify which cross-modal relationships should be learned, while prediction between simultaneous observations does not explicitly constrain their action-dependent evolution. We present Spatiotemporal Training with Explicit Prediction (STEP), a one-stage framework that jointly supervises cross-modal relationships and action-dependent state evolution within a shared control representation. Multiple learned queries aggregate depth and proprioceptive tokens into a compact policy state. Bidirectional masked prediction uses each visible modality to predict latent features of the omitted modality, explicitly supervising terrain-body relationships. An action-conditioned predictor maps the current policy state and executed action to the next fused state, with an exponential-moving-average target defined directly in the policy representation space. Simulation comparisons show overall improvements in terrain traversal over evaluated fusion alternatives and ablations, while depth-dropout and delay experiments demonstrate the benefits of both predictive objectives under degraded visual input. Deployed on a 23-DoF Noetix E1 humanoid with onboard sensing, STEP succeeds in 98 of 100 hardware trials across stairs, a 40\,cm platform, a 70\,cm gap, stepping stones, and backward stair traversal without rearward terrain visibility.
PolygMap: A Perceptive Locomotion Framework for Humanoid Robot Stair Climbing
The Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人社会研究院);Electronic science and technology, Guangdong University of Technology(广东技术大学电子科学与技术学院);Leju robotics(乐居机器人)
LIPM-Guided Reinforcement Learning for Stable and Perceptive Locomotion in Bipedal Robots
School of Automation and Intelligent Manufacturing (AIM), Southern University of Science and Technology(自动化与智能制造学院,南方科技大学);Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology(土木与环境工程系,香港科技大学);Department of Mechanical Engineering, The University of Hong Kong(机械工程系,香港大学);Zhejiang University-University of Illinois Urbana-Champaign Institute (ZJUI), Zhejiang University(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究所,浙江大学);LimX Dynamics, Shenzhen, China(深圳LimX动力有限公司)
Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction
Department of Electronic Engineering and Information Science (EEIS), University of Science and Technology of China(电子工程与信息科学系,中国科学技术大学);LimX Dynamics(LimX动力学);Hong Kong University of Science and Technology(香港科技大学);School of Mechanics Engineering, Harbin Institute of Technology (HIT)(机械工程学院,哈尔滨工业大学);Department of Computing, The Hong Kong Polytechnic University(计算学院,香港理工大学);Zhejiang University-University of Illinois Urbana-Champaign Institute (ZJUI)(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究所)
Learning robust perceptive locomotion for quadrupedal robots in the wild
Robotic Systems Lab, ETH Zurich(苏黎世联邦理工学院机器人系统实验室);Robotics and Artificial Intelligence Lab, KAIST(韩国科学技术院机器人与人工智能实验室);Intelligent Systems Lab, Intel(英特尔智能系统实验室)
Artificial General Intelligence Institute, University of Science and Technology of China(中国科学技术大学通用人工智能研究院);X-Humanoid(X-人形机器人);The University of Hong Kong(香港大学);The Australian National University(澳大利亚国立大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Shanghai Jiao Tong University(上海交通大学);The Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学)
ADAPT: Adaptive Dual-projection Architecture for Perceptive Traversal
Department of Automation, University of Science and Technology of China(自动化系,中国科学技术大学);Institute of Humanoid Robots, Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China(人形机器人研究所,精密仪器与机械系,中国科学技术大学)
HC2Robot: Hyper-Connection Transformers with Predicted Foresight for Multi-Terrain Humanoid Parkour
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));CL-TECH;South China Agricultural University(华南农业大学);Southern University of Science and Technology(南方科技大学)
PILOT: A Perceptive Integrated Low-level Controller for Loco-manipulation over Unstructured Scenes
School of Automation and Intelligent Sensing(自动化与智能感知学院);Shanghai Jiao Tong University(上海交通大学);Global College(全球学院);school of Computer Science(计算机科学学院);Shanghai Key Laboratory of Navigation and Location Based Services(导航与位置基于服务上海市重点实验室)
Biomechanical Comparisons Reveal Divergence of Human and Humanoid Gaits
Zhejiang University(浙江大学);School of Engineering, Westlake University(西湖大学工程学院);Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences(中国科学院宁波材料技术与工程研究所)
FootQuery: Future-Touchdown-Guided Retrieval from Depth History for Perceptive Humanoid Locomotion
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));University of Science and Technology Beijing(北京科技大学);Nanyang Technological University(南洋理工大学)