OASIS: From Simulation Data Collection to Real-World Humanoid Loco-Manipulation
Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI));Fudan University(复旦大学);East China University of Science and Technology(华东理工大学);Shanghai Jiao Tong University(上海交通大学)
Recent progress in robot manipulation has been largely driven by learning from large-scale demonstrations. For humanoid robot loco-manipulation tasks, however, existing data sources force an unsatisfying tradeoff between trajectory quality and scalability. Real-world teleoperation provides the highest-quality trajectories but requires dedicated physical space and time-consuming scene resets. Simulation offers an alternative way out of this dilemma: it can produce clean, embodiment-aligned data at scale without any physical hardware. In this paper, we propose OASIS, a simulation-data-driven framework for humanoid loco-manipulation. OASIS automatically reconstructs realistic object assets from real-world images using a 3D generative model. Based on these assets, trajectories are first collected through teleoperation in simulation, and then augmented under diverse domain randomizations in a post-processing stage. With the resulting simulation data, we further design a hierarchical visuomotor policy for humanoid loco-manipulation. Extensive experiments on the real humanoid robot show that, under zero-shot deployment, the policy trained on our simulation data achieves higher success rates on most tasks than that trained on real-robot teleoperation data, owing largely to the broad lighting and environmental variations covered by our simulation rendering, which real-robot data fails to capture. The project page is available at https://oasis-humanoid.github.io/.
Humanoid Loco-manipulation Planning based on Graph Search and Reachability Maps
CNRS-AIST JRL (Joint Robotics Laboratory)(CNRS-AIST联合机器人实验室);IRL(机器人研究所);National Institute of Advanced Industrial Science and Technology (AIST)(国家先进工业科学与技术研究院)
Humanoid Agent via Embodied Chain-of-Action Reasoning with Multimodal Foundation Models for Zero-Shot Loco-Manipulation
Embodied AI and Robotics (AIR) Lab, New York University, New York, USA and NYUAD Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, UAE(纽约大学Embodied AI和机器人实验室及纽约大学阿布扎赫尔人工智能与机器人中心);Harvard AI and Robotics Lab, Harvard University, Boston, USA(哈佛大学人工智能与机器人实验室);Department of Computer Science, University College London, London, UK(伦敦大学学院计算机科学系);Department of Computer Science, University of Liverpool, UK(利物浦大学计算机科学系);NYUAD Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, UAE(纽约大学阿布扎赫尔人工智能与机器人中心)
HWC-Loco: A Hierarchical Whole-Body Control Approach to Robust Humanoid Locomotion
The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Harbin Institute of Technology(哈尔滨工业大学);DexForce Technology(DexForce科技);Southeast University(东南大学)
State Estimation for Human Motion and Humanoid Locomotion
Istituto Italiano di Tecnologia(意大利理工学院);IRI CSIC-UPC(西班牙国家研究委员会-加泰罗尼亚理工大学机器人研究所);AIST(日本产业技术综合研究所);LAAS-CNRS(法国国家科学研究中心系统分析与架构实验室);DIBRIS-UNIGE(热那亚大学计算机、生物工程、机器人与系统工程系)
GM-Loco: Terrain-Adaptive Humanoid Locomotion on Granular Media
Institute for Robotics and Intelligent Machines, Georgia Institute of Technology(佐治亚理工学院机器人与智能机器研究所);School of Physics, Georgia Institute of Technology(佐治亚理工学院物理学院);Northeastern University(东北大学)
Biomechanical Comparisons Reveal Divergence of Human and Humanoid Gaits
Zhejiang University(浙江大学);School of Engineering, Westlake University(西湖大学工程学院);Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences(中国科学院宁波材料技术与工程研究所)
X2-N: A Transformable Wheel-legged Humanoid Robot with Dual-mode Locomotion and Manipulation
Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology(香港理工大学电子与计算机工程系);X-lab Department, Agibot Innovation Company(阿吉博创新公司X实验室)
ViLoMan: Learning Visual-Proprioceptive Whole-Body Loco-Manipulation Skills for Humanoid Robots
State Key Laboratory of AI Safety, Institute of Computing Technology, CAS(中国科学院计算技术研究所人工智能安全国家重点实验室);University of Chinese Academy of Sciences (CAS)(中国科学院大学);Beijing Academy of Artificial Intelligence (BAAI)(北京智源人工智能研究院)
ULC: A Unified and Fine-Grained Controller for Humanoid Loco-Manipulation
State Key Laboratory of Robotics and Systems, Harbin Institute of Technology(机器人与系统国家重点实验室,哈尔滨工业大学);School of Engineering, Westlake University(工程学院,西湖大学)