The capability of performing long-horizon, language-guided robotic manipulation tasks critically relies on leveraging historical information and generating coherent action sequences. However, such capabilities are often overlooked by existing Vision-Language-Action (VLA) models. To solve this challenge, we propose LoLA (Long Horizon Latent Action Learning), a framework designed for robot manipulation that integrates long-term multi-view observations and robot proprioception to enable multi-step reasoning and action generation. We first employ Vision-Language Models to encode rich contextual features from historical sequences and multi-view observations. We further introduces a key module, State-Aware Latent Re-representation, which transforms visual inputs and language commands into actionable robot motion space. Unlike existing VLA approaches that merely concatenate robot proprioception (e.g., joint angles) with VL embeddings, this module leverages such robot states to explicitly ground VL representations in physical scale through a learnable "embodiment-anchored" latent space. We trained LoLA on diverse robotic pre-training datasets and conducted extensive evaluations on simulation benchmarks (SIMPLER and LIBERO), as well as two real-world tasks on Franka and Bi-Manual Aloha robots. Results show that LoLA significantly outperforms prior state-of-the-art methods (e.g., pi0), particularly in long-horizon manipulation tasks.
EmbodiedVAE: Disentangled Video VAE for Efficient and Controllable Embodied Manipulation
Beihang University(北京航空航天大学);Zhongguancun Academy(中关村学院);University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学);CASIA, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所(CASIA));Microsoft Research Asia(微软亚洲研究院)
Learning Action Manifold with Multi-view Latent Priors for Robotic Manipulation
Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(机器智能与先进计算国家重点实验室,教育部,中国);AMap, Alibaba Group(阿里的AMap);Xi’an Jiaotong University(西安交通大学);Shenzhen University of Advanced Technology(深圳先进技术大学)
HiMem-WAM: Hierarchical Memory-Gated World Action Models for Robotic Manipulation
The University of Hong Kong(香港大学);INFIFORCE;Huazhong University of Science and Technology(华中科技大学);Tsinghua University(清华大学);Wuhan University(武汉大学);Southern University of Science and Technology(南方科技大学)
ConLA: Contrastive Latent Action Learning from Human Videos for Robotic Manipulation
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));State Key Laboratory of Mobile Network and Mobile Multimedia Technology, Shenzhen(移动网络与移动多媒体技术国家重点实验室(深圳));ZTE Corporation(中兴通讯);Shanghai Jiao Tong University(上海交通大学);Central South University(中南大学)
DeltaWorld: Physically Consistent Interactive World Simulators via Action-Conditioned Latent Increment Learning
Imprintx Robotics(印迹机器人);Electric Power Research Institute of State Grid Jibei Electric Power Co., Ltd.(国网冀北电力有限公司电力科学研究院);North China Electric Power Research Institute Co., Ltd.(华北电力科学研究院有限责任公司);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
LaST-HD: Learning Latent Physical Reasoning from Scalable Human Data for Robot Manipulation
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机学院多媒体信息处理国家重点实验室);The Chinese University of Hong Kong(香港中文大学);Simplexity Robotics;Aether Tech
From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulation
School of Data Science, Fudan University(复旦大学数据科学学院);Shanghai Innovation Institute(上海创新研究院);Imperial College London(伦敦帝国理工学院);University of Surrey(萨里大学)
Learning Structural Latent Points for Efficient Visual Representations in Robotic Manipulation
The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));MMLab, The Chinese University of Hong Kong(香港中文大学MMLab);X-Humanoid Robots(X-Humanoid机器人);The University of Hong Kong(香港大学);Tsinghua University(清华大学)
LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning
The Chinese University of Hong Kong(香港中文大学);State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(北京大学多媒体信息处理国家重点实验室,计算机学院);Simplexity Robotics Project(Simplexity机器人项目)
World-to-Wrist: Task-Conditioned Future Wrist Modeling for Fine-Grained Robot Manipulation
The Hong Kong University of Science and Technology(香港科技大学);National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);Wuhan University(武汉大学);Sun Yat-sen University(中山大学);Xidian University(西安电子科技大学);Southeast University(东南大学)
DUET-DINO: Simultaneous Cross-View World Modeling for Latent Planning in Robot Manipulation
University of Technology Nuremberg (UTN)(纽伦堡工业大学);Technical University of Munich (TUM)(慕尼黑工业大学);Karlsruhe Institute of Technology (KIT)(卡尔斯鲁厄理工学院);NVIDIA(英伟达);Robotics Institute Germany(德国机器人研究所)
Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videos
The University of Hong Kong(香港大学);ARC Lab, Tencent PCG(腾讯PCG实验室);The Chinese University of Hong Kong(香港中文大学);University of California, Berkeley(加州大学伯克利分校)
Multimodal Anomaly Detection based on Deep Auto-Encoder for Object Slip Perception of Mobile Manipulation Robots
Artificial Intelligence Institute, Seoul National University(首尔国立大学人工智能研究所);Dept. of Computer Science and Engineering, Seoul National University(首尔国立大学计算机科学与工程系);Interdisciplinary Program in Neuroscience, Seoul National University(首尔国立大学神经科学跨学科项目);Surromind Inc.(Surromind公司)
DeformNet: Latent Space Modeling and Dynamics Prediction for Deformable Object Manipulation
Tsinghua-Berkeley Shenzhen Institute(清华-伯克利深圳学院);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Tsinghua University(清华大学);RISC-V International Open Source Laboratory(RISC-V国际开源实验室);Institute for Interdisciplinary Information Sciences (IIIS)(交叉信息研究院)