General-purpose robots operating in partially observable environments, such as homes, require memory to support autonomy. They must recall diverse information from the past, such as where objects were placed, which tasks a human partner has completed, and when an appliance was turned on. Achieving this versatility requires a general memory retrieval mechanism. Transformer architectures that use attention over long contexts for memory retrieval provide a promising approach, as they learn retrieval from data rather than relying on task-specific or hand-designed rules. However, directly incorporating them into imitation learning from offline data introduces two key challenges: (1) the policy may learn spurious correlations between past information and predicted actions, and (2) errors accumulate in memory due to prediction inaccuracies and their compounding interactions with the environment, causing model drift and cascading failures. To address both challenges, we introduce HALO, a visuomotor policy with an attention-based memory retrieval mechanism for long-horizon control. First, to suppress spurious correlations, HALO distills vision-language model (VLM) priors into the policy. It generates memory-dependent question--answer pairs from demonstration trajectories and trains jointly with a video question--answering objective, steering retrieval toward task-relevant information. Second, to reduce the impact of accumulated errors in memory during closed-loop control, HALO uses sparse attention that restricts retrieval to only the most relevant parts of the history. Together, these components enable more reliable long-horizon control by guiding the policy to retrieve task-relevant information from up to eight minutes of past experience. Project website: https://robin-lab.cs.utexas.edu/HALO
Decompose and Reorganize: Planning with Primitives and Visuomotor Policies Learned from Demonstrations
The University of Hong Kong(香港大学);JD.com (JingDong)(京东);Nanyang Technological University (NTU)(南洋理工大学);Southern University of Science and Technology (SUSTech)(南方科技大学);Huawei Technologies(华为技术有限公司);The Chinese University of Hong Kong (CUHK)(香港中文大学)
eVGGT: An Efficient Geometry-Aware Vision Encoder for Visuomotor Policies
Department of Computer Vision, Mohammed bin Zayed University of Artificial Intelligence(计算机视觉系,穆罕默德·本·扎耶德人工智能大学);AIT Austrian Institute of Technology GmbH(奥地利技术研究所)
DemoSpeedup: Accelerating Visuomotor Policies via Entropy-Guided Demonstration Acceleration
Shanghai Qi Zhi Institute(上海启智研究院);Tsinghua University IIIS(清华大学智能科学研究院);Shanghai AI Lab(上海人工智能实验室);University of Electronic Science and Technology of China(电子科技大学)
EmbodiSteer: Steering Embodiment-Agnostic Visuomotor Policies with Joint-Space Guidance for Zero-Shot Cross-Embodiment Deployment
Department of Automation, Tsinghua University(清华大学自动化系);Beijing Key Laboratory of Embodied Intelligence Systems(北京具身智能系统重点实验室);Institute for Embodied Intelligence and Robotics, Tsinghua University(清华大学具身智能与机器人研究所)
Learning Coordinated Visuomotor Box-Pushing from Solo Demonstrations
National Institute of Advanced Industrial Science and Technology (AIST)(国立产业技术综合研究所(AIST));Institute of Science Tokyo(东京科学大学);The University of Tokyo(东京大学)
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);State Key Laboratory of Brain Cognition and Brain-Inspired Intelligence Technology(脑认知与脑启发智能技术国家重点实验室);Institute of Semiconductors, Chinese Academy of Sciences(中国科学院半导体研究所)
ImitDiff: Transferring Foundation-Model Priors for Distraction Robust Visuomotor Policy
Ningbo Global Innovation Center, Zhejiang University(浙江大学宁波全球创新中心);Tsinghua University(清华大学);Youtu, Tencent(腾讯优图);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院)
AimBot: A Simple Auxiliary Visual Cue to Enhance Spatial Awareness of Visuomotor Policies
Computer Science and Engineering Department, University of Michigan(密歇根大学计算机科学与工程系);Robotics Department, University of Michigan(密歇根大学机器人学系);Lambda Labs(Lambda实验室)
A Study on Enhancing the Generalization Ability of Visuomotor Policies via Data Augmentation
University of Chinese Academy of Sciences(中国科学院大学);School of Artificial Intelligence & Institute of Automation, Chinese Academy of Sciences & NLPR(中国科学院人工智能学院与自动化研究所)