arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.25136cs.RO
收藏

视觉运动策略中的记忆检索用于长期机器人控制

Memory Retrieval in Visuomotor Policies for Long-Horizon Robot Control

The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Rutav Shah, Yisu Li, Femi Bello, Yuke Zhu, Roberto Martín-Martín

AI总结:

提出HALO策略,通过注意力记忆检索机制和视觉语言模型先验蒸馏,解决长期控制中的虚假相关和记忆误差累积问题,实现从长达8分钟历史中检索任务相关信息。

摘要:

在部分可观测环境(如家庭)中运行的通用机器人需要记忆来支持自主性。它们必须回忆过去的各种信息,例如物体放置的位置、人类伙伴完成的任务以及电器何时开启。实现这种多功能性需要通用的记忆检索机制。使用注意力机制在长上下文中进行记忆检索的Transformer架构提供了一种有前景的方法,因为它们从数据中学习检索,而不是依赖特定任务或手工设计的规则。然而,将其直接纳入从离线数据进行的模仿学习会带来两个关键挑战:(1)策略可能学习过去信息与预测动作之间的虚假相关;(2)由于预测不准确及其与环境的复合交互,记忆中的误差会累积,导致模型漂移和级联故障。为了解决这两个挑战,我们引入了HALO,一种具有基于注意力的记忆检索机制的视觉运动策略,用于长期控制。首先,为了抑制虚假相关,HALO将视觉语言模型(VLM)先验蒸馏到策略中。它从演示轨迹中生成依赖记忆的问答对,并与视频问答目标联合训练,将检索引导到任务相关信息。其次,为了减少闭环控制期间记忆中累积误差的影响,HALO使用稀疏注意力,将检索限制在历史中最相关的部分。这些组件共同通过引导策略从长达八分钟的过去经验中检索任务相关信息,实现了更可靠的长期控制。项目网站:此 https URL

英文摘要:

General-purpose robots operating in partially observable environments, such as homes, require memory to support autonomy. They must recall diverse information from the past, such as where objects were placed, which tasks a human partner has completed, and when an appliance was turned on. Achieving this versatility requires a general memory retrieval mechanism. Transformer architectures that use attention over long contexts for memory retrieval provide a promising approach, as they learn retrieval from data rather than relying on task-specific or hand-designed rules. However, directly incorporating them into imitation learning from offline data introduces two key challenges: (1) the policy may learn spurious correlations between past information and predicted actions, and (2) errors accumulate in memory due to prediction inaccuracies and their compounding interactions with the environment, causing model drift and cascading failures. To address both challenges, we introduce HALO, a visuomotor policy with an attention-based memory retrieval mechanism for long-horizon control. First, to suppress spurious correlations, HALO distills vision-language model (VLM) priors into the policy. It generates memory-dependent question--answer pairs from demonstration trajectories and trains jointly with a video question--answering objective, steering retrieval toward task-relevant information. Second, to reduce the impact of accumulated errors in memory during closed-loop control, HALO uses sparse attention that restricts retrieval to only the most relevant parts of the history. Together, these components enable more reliable long-horizon control by guiding the policy to retrieve task-relevant information from up to eight minutes of past experience. Project website: https://robin-lab.cs.utexas.edu/HALO

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑