XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations
Beijing Innovation Center of Humanoid Robotics, Beijing, China(北京人形机器人创新中心,北京,中国);School of Mechanical Engineering and Automation, Beihang University, Beijing, China(北京航空航天大学机械工程及自动化学院,北京,中国);State Key Laboratory of Virtual Reality Technology and Systems, SCSE, Beihang University, Beijing, China(虚拟现实技术与系统国家重点实验室,SCSE,北京航空航天大学,北京,中国);State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University, Beijing, China(多媒体信息处理国家重点实验室,计算机科学学院,北京大学,北京,中国)
Shichao Fan, Kun Wu, Zhengping Che, Xinhua Wang, Di Wu, Fei Liao, Ning Liu, Yixue Zhang, Zhen Zhao, Zhiyuan Xu, Meng Li, Qingjie Liu, Shanghang Zhang, Min Wan, Jian Tang
Recent progress in large-scale robotic datasets and vision-language models (VLMs) has advanced research on vision-language-action (VLA) models. However, existing VLA models still face two fundamental challenges: (i) producing precise low-level actions from high-dimensional observations, (ii) bridging domain gaps across heterogeneous data sources, including diverse robot embodiments and human demonstrations. Existing methods often encode latent variables from either visual dynamics or robotic actions to guide policy learning, but they fail to fully exploit the complementary multi-modal knowledge present in large-scale, heterogeneous datasets. In this work, we present X Robotic Model 1 (XR-1), a novel framework for versatile and scalable VLA learning across diverse robots, tasks, and environments. XR-1 introduces the \emph{Unified Vision-Motion Codes (UVMC)}, a discrete latent representation learned via a dual-branch VQ-VAE that jointly encodes visual dynamics and robotic motion. UVMC addresses these challenges by (i) serving as an intermediate representation between the observations and actions, and (ii) aligning multimodal dynamic information from heterogeneous data sources to capture complementary knowledge. To effectively exploit UVMC, we propose a three-stage training paradigm: (i) self-supervised UVMC learning, (ii) UVMC-guided pretraining on large-scale cross-embodiment robotic datasets, and (iii) task-specific post-training. We validate XR-1 through extensive real-world experiments with more than 14,000 rollouts on six different robot embodiments, spanning over 120 diverse manipulation tasks. XR-1 consistently outperforms state-of-the-art baselines such as $π_{0.5}$, $π_0$, RDT, UniVLA, and GR00T-N1.5 while demonstrating strong generalization to novel objects, background variations, distractors, and illumination changes. Our project is at https://xr-1-vla.github.io/.
Versatile, Robust, and Explosive Locomotion with Rigid and Articulated Compliant Quadrupeds
Cognitive Robotics, Delft University of Technology(代尔夫特理工大学认知机器人学系);University of Trento(特伦托大学);University of Manchester(曼彻斯特大学);Institute of Robotics and Mechatronics, German Aerospace Center (DLR)(德国航空航天中心机器人与机电一体化研究所)
M3imic: Learning a Versatile Whole-Body Controller for Multimodal Motion Mimicking
School of Automation, Southeast University(东南大学自动化学院);School of Vehicle and Mobility, Tsinghua University(清华大学车辆与移动性学院);Department of Robotics, Mohamed Bin Zayed University of Artificial Intelligence(马尔代夫比兹亚德大学人工智能学院机器人系)
KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Control
Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信);Shanghai Jiao Tong University(上海交通大学);East China University of Science and Technology(东华大学)
VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluation
Adelaide University(阿德莱德大学);Responsible AI Research Centre, Australian Institute for Machine Learning(负责任人工智能研究中心、澳大利亚机器学习研究所);Tongji University(同济大学);ManyCore;Zhejiang University(浙江大学);Shanghai AI Lab(上海人工智能实验室);CSIRO Data61
Versatile Distributed Maneuvering with Generalized Formations using Guiding Vector Fields
College of Intelligence Science and Technology, National University of Defense Technology(智能科学与技术学院,国防科技大学);College of Information Science and Engineering, Hunan Normal University(信息科学与工程学院,湖南师范大学);School of Robotics, Hunan University(机器人学院,湖南大学)
A High-frequency, Interaction-induced Pneumatic Oscillator Enabling Versatile Soft Robotics
Beijing University of Chemical Technology(北京化工大学);Ritsumeikan University(立命馆大学);University of Bristol(布里斯托大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Tsinghua University(清华大学)